Apparatus and method for streaming video data to viewing terminals

ABSTRACT

A terminal comprises processing circuitry configured to control a display to display a character video including a first character object representing a stream user; transmit character information to a plurality of viewing user terminals to display the character video to a plurality of viewing users different from the stream user; control the display to display a screen for a game played by the stream user; transmit game information to the plurality of viewing user terminals to display the game video to the plurality of viewing users; and produce a game effect according to instructions for the stream user from a viewing user terminal of one viewing user of the plurality of viewing users. Display of the screen includes displaying at least one of a screen for a first game and a screen for a second game as the screen for the game according to a progress of the game.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority to JP 2020-112715, filed inJapan on Jun. 30, 2020, and the entire contents of which is incorporatedby reference in its entirety.

TECHNICAL FIELD

The embodiment disclosed herein relates to a non-transitory computerreadable medium storing a control program for a terminal, a controlmethod for a terminal, a terminal, a control method for a serverapparatus, a method performed by one or more processors, and a streamsystem.

BACKGROUND

Conventional video stream systems may stream data including video datato one or more terminals. The conventional video stream systems usetechniques that allow a viewer, who views a stream screen based on thestream data, to operate a terminal so that predetermined objects,comments, and the like are provided to a streamer of the video data. Forinstance, a video stream system streams to one or more terminals thestream data in which video data from a streamer and image data showingan item provided by a viewer are displayed at the same time. In thisvideo stream system, each viewer can view image data showing itemsprovided by the viewer and/or items provided by other viewers along withthe video data from the streamer.

SUMMARY

In an exemplary implementation of the present application, a terminalcomprises processing circuitry configured to control a display todisplay a character video including a first character objectrepresenting a stream user; transmit character information to aplurality of viewing user terminals to display the character video to aplurality of viewing users different from the stream user; control thedisplay to display a screen for a game played by the stream user;transmit game information to the plurality of viewing user terminals todisplay the game video to the plurality of viewing users; and produce agame effect according to instructions for the stream user from a viewinguser terminal of one viewing user of the plurality of viewing users.Display of the screen includes displaying at least one of a screen for afirst game and a screen for a second game as the screen for the gameaccording to a progress of the game. To produce the game effect, theprocessing circuitry determines whether the game effect to be producedis a game effect on the first game, and in a case that the determiningindicates that the game effect to be produced is not a game effect onthe first game, produces a game effect different from the game effect onthe first game.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are schematic diagrams for illustrating an example of anoverview of a video stream system;

FIG. 2 is an illustration showing an example of a schematicconfiguration of the video stream system;

FIG. 3 is a diagram illustrating an example of a schematic configurationof a terminal;

FIGS. 4A to 4C are tables illustrating an example of data structures ofvarious tables;

FIG. 5A is a perspective view illustrating an example of a user whooperates a terminal, and FIG. 5B is a perspective view illustrating anexample of a terminal;

FIG. 6 is a diagram illustrating an example of a schematic configurationof a server apparatus;

FIGS. 7A and 7B are each a view illustrating an example of a screendisplayed on a display unit of a terminal;

FIGS. 8A and 8B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 9A and 9B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 10A and 10B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 11A and 11B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 12A and 12B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 13A and 13B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 14A and 14B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 15A and 15B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIGS. 16A and 16B are each a view illustrating an example of a screendisplayed on the display unit of the terminal;

FIG. 17 is a diagram illustrating an example of an operation sequence ofthe video stream system;

FIG. 18 is a diagram illustrating another example of an operationsequence of the video stream system; and

FIG. 19 is a chart illustrating an example of an operation flow of gamestream screen display processing.

DETAILED DESCRIPTION OF THE DRAWINGS

In a video stream system in related art, various types of data are used,such as video data of a character object representing the streamer andvideo data in which a gameplay is captured, as the stream data providedby the streamer. When instructions to display an object such as an itemalong with a video based on stream data are input to a terminal by aviewer, a display object corresponding to the input instructions issimilarly displayed regardless of the type of the stream data beingstreamed.

However, even during streaming of video data of a gameplay of astreamer, it has been difficult to give each viewer the feeling ofjoining in or cooperating with the gameplay of the streamer just byproviding the same display objects as in the video data of characterobjects. Similarly, it has been not possible to provide variousinteractions with the stream event of a streamer, suitable for the typeof the stream data just by generating the same event effect (such as useof a virtual or real monetary value, and a game effect on the game beingplayed) in the video data of the gameplay of the streamer and the videodata of characters.

Also, in the video stream system in related art, when display objectsand event effects of different types are prepared for respective piecesof stream data as the display objects and event effects which can beprovided by a viewer, user interface on the viewer side may becomecomplicated, and it may be difficult for the viewer to interact with astream event immediately. The inventors of the present disclosure havedeveloped technology to address these issues.

In an exemplary implementation of the present application, anon-transitory computer readable medium storing a control program for aterminal, control method for a terminal, terminal, control method for aserver apparatus, method performed by one or more processors, and streamsystem have been devised to cope with such problems, and make itpossible to improve the game performance related to a streamed gamevideo and/or the sense of togetherness between users for a stream eventwithout making the user interface complicated.

The non-transitory computer readable medium stores a control program fora terminal including one or a plurality of processors, and the controlprogram causes the one or plurality of processors to execute a processincluding: displaying a character video including a first characterobject representing a stream user and transmitting information todisplay the character video to a terminal of at least one viewing userdifferent from the stream user; displaying a screen for a game played bythe stream user and transmitting information to display a game videoincluding the screen for the game to the terminal of the at least oneviewing user; and producing a game effect according to instructions forthe stream user from a terminal of one of the at least one viewing user.At least one of a screen for a first game and a screen for a second gameis displayed as a screen for the game according to progress of the game,and in the producing of the game effect, it is determined whether thegame effect to be produced is a game effect on the first game, and upondetermination that the game effect to be produced is not a game effecton the first game, a game effect different from the game effect on thefirst game is produced.

In addition, in the non-transitory computer readable medium, it ispreferable that a gift object according to instructions for a streamuser from a terminal of one of at least one viewing user be displayedduring display of a character video.

In addition, in the non-transitory computer readable medium, preferably,the control program further causes the one or plurality processors toupon end of the game, end display of the screen for the game and startdisplay of the character video, and upon start of the display of thecharacter video, display a gift object according to each of theinstructions given during execution of the game.

In addition, in the non-transitory computer readable medium, preferably,in the screen for the first game, a first character image showing thefirst character object is displayed, and in the screen for the secondgame, the first character image is not displayed.

In addition, in the non-transitory computer readable medium, preferably,a second character image showing a second character object is displayedin the screen for the first game and the screen for the second game, thesecond character object representing a viewing user who has given theinstructions.

In addition, in the non-transitory computer readable medium, preferably,the second game starts in response to an end of execution of the firstgame, and the game effect on the first game is an effect of reducing anexecution time of the first game.

In addition, in the non-transitory computer readable medium, preferably,an image showing a predetermined game medium is displayed on the screenfor the second game, the predetermined game medium is automaticallyselected from a plurality of game media according to progress of thefirst game, and the game effect on the first game is an effect ofincreasing a selection probability of a specific type of a game medium.

In addition, in the non-transitory computer readable medium, preferably,the predetermined game medium shown by the image displayed on the screenfor the second game is associated with points, and a game effect on thesecond game is an effect of changing the points.

In addition, in the non-transitory computer readable medium, preferably,the control program further causes the one or plurality of processors tochange the points in response to a game operation of the stream user inthe second game, and upon the points reaching predetermined points, endexecution of the second game and associate a game medium image with thestream user, the game medium image showing the predetermined gamemedium.

In addition, in the non-transitory computer readable medium, preferably,the control program further causes the one or plurality of processorsto, upon the points reaching the predetermined points in the secondgame, associate an image with each of the stream user and the viewinguser who has given the instructions, the image including the game mediumimage showing the predetermined game medium, an image showing the firstcharacter object representing the stream user, and an image showing asecond character object representing the viewing user who has given theinstructions during execution of the second game.

The control method for a terminal provides a method of controlling aterminal including one or a plurality of processors, the method causingthe one or plurality of processors to execute a process including:displaying a character video including a first character objectrepresenting a stream user, and transmitting information to display thecharacter video to a terminal of at least one viewing user differentfrom the stream user; displaying a screen for a game played by thestream user, and transmitting information to display a game videoincluding the screen for the game to the terminal of the at least oneviewing user; and producing a game effect according to instructions forthe stream user from a terminal of one of the at least one viewing user.At least one of a screen for a first game and a screen for a second gameis displayed as a screen for the game according to progress of the game,and in the producing of the game effect, it is determined whether thegame effect to be produced is a game effect on the first game, and upondetermination that the game effect to be produced is not a game effecton the first game, a game effect different from the game effect on thefirst game is produced.

The terminal includes one or a plurality of processors configured toexecute a process including: receiving information to display acharacter video including a first character object representing a streamuser from a terminal of the stream user; receiving information todisplay a game video including a screen for a game played by the streamuser from the terminal of the stream user; and transmitting instructionsfor the stream user to produce a game effect. At least one of a screenfor a first game and a screen for a second game is displayed as a screenfor the game according to progress of the game, and in producing of thegame effect, it is determined whether the game effect to be produced isa game effect on the first game, and upon determination that the gameeffect to be produced is not a game effect on the first game, a gameeffect different from the game effect on the first game is produced.

The control method for a server apparatus provides a method ofcontrolling a server apparatus including one or a plurality ofprocessors, the method causing the one or plurality of processors toexecute a process including: receiving information to display acharacter video including a first character object representing a streamuser from a terminal of the stream user; transmitting information todisplay the character video to a terminal of at least one viewing userdifferent from the stream user; receiving information to display a gamevideo including a screen for a game played by the stream user from theterminal of the stream user; transmitting the information to display thegame video to the terminal of the at least one viewing user; andproducing in the terminal of the stream user a game effect according toinstructions for the stream user from a terminal of one of the at leastone viewing user. At least one of a screen for a first game and a screenfor a second game is displayed as a screen for the game according toprogress of the game, and in the producing of the game effect, it isdetermined whether the game effect to be produced is a game effect onthe first game, and upon determination that the game effect to beproduced is not a game effect on the first game, a game effect differentfrom the game effect on the first game is produced.

The method performed by one or more processors provides a methodperformed by one or a plurality of processors which execute acomputer-readable command, the method including transmitting a computerprogram to a terminal of a stream user via a communication line, theterminal being configured to stream a character video and a game videoto a terminal of a viewing user via a communication line, the charactervideo including a first character object representing the stream user,the game video including a screen for a game played by the stream user,the computer program causing the terminal of the stream user to executea process including receiving instructions from the terminal of theviewing user via a communication line, the instructions being for thestream user and generated by an operation of the viewing user who viewsthe game video; and producing a game effect according to theinstructions. At least one of a screen for a first game and a screen fora second game is displayed as a screen for the game according toprogress of the game. In the producing of the game effect, it isdetermined whether the game effect to be produced is a game effect onthe first game, and upon determination that the game effect to beproduced is not a game effect on the first game, a game effect differentfrom the game effect on the first game is produced.

The stream system includes a stream terminal of a stream user, a viewingterminal of at least one viewing user different from the stream user,and a server apparatus capable of communicating with the stream terminaland the viewing terminal. The stream terminal is configured to display acharacter video including a first character object representing thestream user and transmit information to display the character video tothe server apparatus, and display a screen for a game played by thestream user and transmit information to display a game video includingthe screen for the game to the server apparatus, the viewing terminal isconfigured to transmit instructions for the stream user to produce agame effect to the server apparatus, the server apparatus is configuredto transmit the information to display the character video and theinformation to display the game video to the viewing terminal, andtransmit the instructions to produce the game effect to the streamterminal, and the stream terminal is configured to upon receiving theinstructions, produce the game effect according to the instructions forthe stream user, display at least one of a screen for a first game and ascreen for a second game as a screen for the game according to progressof the game, and in producing of the game effect, determine whether thegame effect to be produced is a game effect on the first game, and upondetermination that the game effect to be produced is not a game effecton the first game, produce a game effect different from the game effecton the first game.

It is possible to improve the game performance related to a streamedgame video and/or the sense of togetherness between users for a streamevent without making the user interface complicated by thenon-transitory computer readable medium storing a control program for aterminal, the control method for a terminal, the terminal, the controlmethod for a server apparatus, the method performed by one or moreprocessors, and the stream system.

Hereinafter, various embodiments of the present disclosure will bedescribed with reference to the drawings. However, it is to be notedthat the technical scope of the present disclosure is not limited tothose embodiments and covers their equivalents.

(Overview of Video Stream System)

FIGS. 1A and 1B are schematic diagrams for illustrating an example of anoverview of a video stream system. The video stream system includesterminals operated by respective users and a server apparatus. Each ofthe terminals is, for instance, a mobile terminal such as amulti-functional mobile phone (so-called “smartphone”) possessed by auser. The server apparatus is a computer to provide a video streamservice to terminals via a communication network.

The terminal stores a video stream application program, loads the videostream application program into a memory in response to a predeterminedstart operation by a user, and executes a command included in the loadedvideo stream application program, thereby making it possible to start aspecific stream event. The terminal has a function of transmitting to aserver apparatus character video data including motion data based onvarious types of data (such as imaging data) input by a user, and gamevideo data to display a video for the game screen of a game being playedby a user in a specific stream event. In addition, the terminal has afunction of displaying a character stream screen and a game streamscreen based on character video stream data and game video stream datafrom the server apparatus. The character video data and the game videodata are each a type of “video data”. Also, the character video streamdata includes character video data, the game video stream data includesgame video data, and the character video stream data and the game videostream data are each a type of “video stream data”. In addition, thecharacter stream screen and the game stream screen are each a type of a“stream screen”.

Hereinafter, in the terminal, a user who uses at least a function oftransmitting video data to the server apparatus may be referred to as astream user, and a terminal operated by a stream user may be referred toas a stream terminal. In addition, in the terminal, a user who uses atleast a function of receiving video stream data and a function ofdisplaying a stream screen may be referred to as a viewing user, and aterminal operated by a viewing user may be referred to as a viewingterminal. Note that one terminal may have both functions of the streamterminal and the viewing terminal.

In the example illustrated in FIG. 1A, when starting a specific streamevent, the stream terminal transmits character video data to the serverapparatus and displays based on motion data character stream screenincluding a character object corresponding to the stream user. Theserver apparatus transmits character video stream data to the viewingterminal, the character video stream data being based on the charactervideo data from the stream terminal. The viewing terminal displays basedon the character video stream data from the server apparatus a characterstream screen including a character object corresponding to the streamuser.

Next, the stream terminal executes various commands contained in thegame program stored in the stream terminal in response to instructionsfor executing a game provided by the stream user, thereby starting thegame and displaying the screen of the started game. The stream terminalprogresses the game based on various commands contained in the gameprogram and a game operation input by a user. Note that in order toexecute the game, the stream terminal may call the browser functionincorporated in the video stream application, receive a web page (adocument written by a markup language such as a hypertext markuplanguage (HTML)) from the server apparatus using the browser function,and perform a game program incorporated in the web page. For instance,use of HTML5 as the markup language enables the stream terminal toeasily execute a new game. Use of such a web application to execute agame in the stream terminal enables the producer of a game program toprovide a new game for a client-side (terminal side) just byincorporating a new game program in a web page transmitted by the serverapparatus, thus the production man-hours of the new game program can besignificantly reduced. In addition, on the client-side, a new game canbe provided only by receiving a web page without downloading a new gameprogram, and as compared with when the game program is downloaded, it ispossible to reduce the load of communication network, the communicationcost and/or the communication time, and simplification of the userinterface can be achieved.

The stream terminal allows at least two types of games to progress andtransmits game video data to the server apparatus, the game video dataincluding display data to display a video on the screen of the game inprogress. When the at least two types of games are the first game andthe second game, the second game starts in response to the end of thefirst game, for instance.

The server apparatus transmits game screen stream data to each viewingterminal, the game screen stream data being based on the game video datafrom the stream terminal. The viewing terminal displays a game streamscreen based on the game screen stream data from the server apparatus,the game stream screen including the video on the screen of a game inprogress in the stream terminal. When the second game ends, the streamterminal resumes transmission of the character video data and display ofthe character stream screen.

The viewing user can input effect instructions to produce apredetermined event effect in a specific event by operating the viewingterminal.

When obtaining effect instructions given by a viewing user from theviewing terminal during transmission of character video stream data, thestream terminal causes a specific gift object to be included in thecharacter stream screen being displayed. In this manner, when the streamscreen is a character stream screen, the stream terminal produces anevent effect that a specific gift object appears (is displayed) in thecharacter stream screen according to effect instructions given by aviewing user. In addition, the viewing terminal causes a specific giftobject to be included in the character stream screen being displayedaccording to effect instructions given by a viewing user during displayof the character stream screen. In this manner, when the stream screenis a character stream screen, the viewing terminal produces an eventeffect that a specific gift object appears (is displayed) in thecharacter stream screen according to effect instructions given by aviewing user.

When obtaining effect instructions given by a viewing user from aviewing terminal during transmission of game video stream data, thestream terminal produces a predetermined game effect on the game beingplayed by the stream user. In this manner, when the stream screen is agame stream screen, the stream terminal produces a predetermined gameeffect as an event effect according to effect instructions given by aviewing user. In addition, the viewing terminal produces a predeterminedgame effect on the game being displayed on the game stream screen andbeing played by a stream user according to effect instructions given bya viewing user during display of the game stream screen. In this manner,when the stream screen is a game stream screen, the viewing terminalproduces a predetermined game effect as an event effect according toeffect instructions given by a viewing user.

When the predetermined game effect to be produced during transmission ofgame video stream data is a first game effect on the first game, thestream terminal produces the first game effect corresponding to thefirst game according to effect instructions given by a viewing user. Forinstance, when the game video stream data being transmitted is fordisplaying a video on the screen of the first game, the stream terminaldetermines that the predetermined game effect to be produced is thefirst game effect on the first game. Also, when the predetermined gameeffect to be produced during display of the game stream screen is thefirst game effect on the first game, the viewing terminal produces thefirst game effect corresponding to the first game according to effectinstructions given by a viewing user. For instance, when the game streamscreen being displayed includes a video on the screen of the first game,the stream terminal determines that the predetermined game effect to beproduced is the first game effect on the first game.

When the predetermined game effect to be produced during transmission ofgame video stream data is a second game effect on the second game, thestream terminal produces the second game effect corresponding to thesecond game according to effect instructions given by a viewing user.For instance, when the game video stream data being transmitted is fordisplaying a video on the screen of the second game, the stream terminaldetermines that the predetermined game effect to be produced is thesecond game effect on the second game. Also, when the predetermined gameeffect to be produced during display of the game stream screen is thesecond game effect on the second game, the viewing terminal produces thesecond game effect corresponding to the second game according to effectinstructions given by a viewing user. For instance, when the game streamscreen being displayed includes a video on the screen of the secondgame, the stream terminal determines that the predetermined game effectto be produced is the second game effect on the second game.

Note that the first game effect is, for instance, the effect of reducingthe execution time of the first game, and the second game effect is, forinstance, the effect of changing predetermined points associated withgame clear of the second game. Note that the first game effect and thesecond game effect may be any effect as long as the first and secondgame effects are different from each other.

When the moment of generation of an event effect corresponding to effectinstructions given by a viewing user is during transmission of the gamevideo stream data to display a video on the screen of the first game(during display of the game stream screen including a video on thescreen of the first game), the stream terminal produces the first gameeffect corresponding to the first game as an event effect. In addition,when the moment of generation of an event effect corresponding to effectinstructions given by a viewing user is during display of the gamestream screen including a video on the screen of the first game, theviewing terminal produces the first game effect corresponding to thefirst game as an event effect.

As in the example illustrated in FIG. 1B, even when effect instructionsgiven by a viewing user is obtained by the stream terminal duringtransmission of the character video stream data (during display of thecharacter stream screen), while an event effect corresponding to effectinstructions given by another viewing user and obtained earlier is beingproduced in the order of obtained effect instructions, transmission ofthe game video stream data to display a video on the screen of the firstgame (display of the game stream screen including a video on the screenof the first game) may be started. In such a case, even when the streamterminal obtains effect instructions given by a viewing user duringtransmission of the character video stream data (during display of thecharacter stream screen), if the moment of generation of an event effectis during transmission of the game video stream data to display a videoon the screen of the first game (during display of the game streamscreen including a video on the screen of the first game), the streamterminal produces the first game effect corresponding to the first game.

When the moment of generation of an event effect corresponding to effectinstructions given by a viewing user is during transmission of the gamevideo stream data to display a video on the screen of the second game(during display of the game stream screen including a video on thescreen of the second game), the stream terminal produces the second gameeffect corresponding to the second game as an event effect. In addition,when the moment of generation of an event effect corresponding to effectinstructions given by a viewing user is during display of the gamestream screen including a video on the screen of the second game, theviewing terminal produces the second game effect corresponding to thesecond game as an event effect.

For instance, even when effect instructions given by a viewing user isobtained by the stream terminal during transmission of the game videostream data to display a video on the screen of the first game (duringdisplay of the game stream screen including a video on the screen of thefirst game), while an event effect corresponding to effect instructionsgiven by another viewing user and obtained earlier is being produced inthe order of obtained effect instructions, transmission of the gamevideo stream data to display a video on the screen of the second game(display of the game stream screen including a video on the screen ofthe second game) may be started. In such a case, even when the streamterminal obtains effect instructions given by a viewing user duringtransmission of the game video stream data to display a video on thescreen of the first game (during display of the game stream screenincluding a video on the screen of the first game), if the moment ofgeneration of an event effect is during transmission of the game videostream data to display a video on the screen of the second game (duringdisplay of the game stream screen including a video on the screen of thesecond game), the stream terminal produces the second game effectcorresponding to the second game.

Also, when the moment of generation of an event effect corresponding toeffect instructions given by a viewing user is during transmission ofthe character video stream data (during display of the character streamscreen), the stream terminal produces an effect that a specific giftobject appears (is displayed) in the character stream screen as an eventeffect. Also, when the moment of generation of an event effectcorresponding to effect instructions given by a viewing user is duringdisplay of the character stream screen, the viewing terminal produces aneffect that a specific gift object appears (is displayed) in thecharacter stream screen as an event effect.

For instance, even when effect instructions given by a viewing user isobtained by the stream terminal during transmission of the game videostream data to display a video on the screen of the second game (duringdisplay of the game stream screen including a video on the screen of thesecond game), while an event effect corresponding to effect instructionsgiven by another viewing user and obtained earlier is being produced inthe order of obtained effect instructions, transmission of the charactervideo stream data (display of the character stream screen) may bestarted. In such a case, even when the stream terminal obtains effectinstructions given by a viewing user during transmission of the gamevideo stream data to display a video on the screen of the second game(during display of the game stream screen including a video on thescreen of the second game), if the moment of generation of an eventeffect is during transmission of the character video stream data (duringdisplay of the character stream screen), the stream terminal produces aneffect that a specific gift object appears (is displayed) in thecharacter stream screen.

As described above with reference to FIGS. 1A and 1B, in the controlprogram for the terminal, the control method for the terminal, theterminal, the control method for the server apparatus, and the videostream system, even when the same effect instructions are input by aviewing user, an event effect according to the stream screen beingdisplayed and/or the video stream data being transmitted are produced.In this manner, the control program for the terminal, the control methodfor the terminal, the terminal, the control method for the serverapparatus, and the video stream system make it possible to improve thegame performance of each game stream screen and to enhance the sense oftogetherness between the stream user and the viewing users for eachstream event without using respective user interfaces for the streamscreen being displayed and/or the video stream data being transmitted(without making the user interface complicated).

Note that explanation for FIGS. 1A and 1B described above is merely adescription for better understanding of the contents of the presentdisclosure. Specifically, the present disclosure may be practiced in theembodiments described below and may be practiced in variousmodifications without substantially departing from the principles of thepresent disclosure. Such modifications are all included in the disclosedscope of the present disclosure.

(Video Stream System 1)

FIG. 2 is an illustration showing an example of a schematicconfiguration of a video stream system 1. The video stream system 1includes terminals 2 operated by respective users, and a serverapparatus 3. For instance, the terminals 2 and the server apparatus 3are connected to each other via a base station 4, a mobile communicationnetwork 5, a gateway 6, and a communication network such as the Internet7. Communication is performed between the terminals 2 and the serverapparatus 3, based on a predetermined communication protocol. Thepredetermined communication protocol is, for instance, HypertextTransfer Protocol (HTTP).

Each terminal 2 is an information processing device, such as asmartphone. The terminal 2 may also be a mobile phone, a tabletterminal, a tablet personal computer (PC), an electronic book reader, ora wearable computer. The terminal 2 may also be a portable game player,a game console or a notebook PC. The terminal 2 may be any informationprocessing device as long as the device enables generation of video dataand/or reproduction of video data based on imaging data captured. Notethat the terminal 2 is a type of a video stream device.

In the example illustrated in FIG. 2 , one server apparatus 3 isillustrated as a component of the video stream system 1. However, theserver apparatus 3 may be a set of physically separate serverapparatuses. In this case, the server apparatuses may each have the samefunction or may collectively have the function of one server apparatus 3in a distributed manner. Note that the server apparatus 3 is a type of avideo stream device.

(Terminal 2)

FIG. 3 is a diagram illustrating an example of a schematic configurationof the terminal 2.

The terminal 2 is connected to the server apparatus 3 via the basestation 4, the mobile communication network 5, the gateway 6 and theInternet 7, and communicates with the server apparatus 3. A streamterminal 2 a generates character video data including motion data andgame video data to display a video on the game screen of a game beingplayed by a user, based on various types of data (such as imaging data)input by a user, and transmits the generated character video data andgame video data to the server apparatus 3. In addition, a viewingterminal 2 b receives character video stream data and game video streamdata which are streamed from the server apparatus 3, and displays acharacter stream screen and a game stream screen based on the receivedcharacter video stream data and game video stream data. In order toimplement such functions, the terminal 2 (the stream terminal 2 a andthe viewing terminal 2 b) includes a communication I/F 21, a storagedevice 22, a display unit 23, an input device 24, an imaging device 25,a microphone 26 and a processor 27.

The communication I/F 21 is implemented as hardware, firmware,communication software, such as a Transmission Control Protocol/InternetProtocol (TCP/IP) driver and a Point-to-Point Protocol (PPP) driver, ora combination thereof. The terminal 2 is able to transmit data toanother device and receive data from another device via thecommunication I/F 21.

The storage device 22 is a semiconductor memory device, such as a readonly memory (ROM), a random access memory (RAM), for instance. Thestorage device 22 stores an operating system program, a driver program,an application program and data which are used for processing in theprocessor 27. The driver program stored in the storage device 22includes an output device driver program that controls the display unit23 and an input device driver program that controls the input device 24.The application program stored in the storage device 22 includes acontrol program that generates video data and reproduces a stream screenbased on the video stream data from the server apparatus 3. The datastored in the storage device 22 includes identifying information (forinstance, a user identification (ID)) to uniquely identify a user. Inaddition, the storage device 22 stores the later-described model data,and background data as the data. In addition, the storage device 22stores the later-described user table T1, object table T2, and effectinstruction history table T3 as the data. Alternatively, the storagedevice 22 may temporarily store data related to predeterminedprocessing. Note that the control program may be the one transmittedfrom the server apparatus 3 or other apparatuses. In an exemplaryimplementation, storage device 22 is a non-transitory computer readablemedium that stores computer executable instructions for execution byprocessor 27.

The background data is asset data to construct a virtual space whichincludes a dynamic image in a stream screen displayed based on videostream data. The background data includes data to draw the background ofa virtual space, data to draw various objects included in a streamscreen, and data to draw various background objects other than thosedisplayed on the stream screen. The background data may include objectlocation information showing the positions of various background objectsin the virtual space.

The display unit 23 is a liquid crystal display. Note that the displayunit 23 may also be an organic electro-luminescence (EL) display. Thedisplay unit 23 displays a video image according to the video image dataand/or a still image according to still image data which are suppliedfrom the processor 27.

The input device 24 is a pointing device, such as a touch panel. Thetouch panel can detect various touch operations, such as a tap, a doubletap, and a drag of a user. The touch panel may include an electrostaticcapacitive proximity sensor, and may be configured to be able to detecta non-contact operation of a user. Note that the input device 24 mayalso be an input key. A user can input a character, a number and asymbol, or a position on the display screen of the display unit 23 usingthe input device 24. When operated by a user, the input device 24generates a signal corresponding to the operation. The input device 24then supplies the generated signal to the processor 27 as instructionsof the user.

The imaging device 25 is a camera having an imaging optical system, animaging device and an image processor. The imaging optical system is,for instance, an optical lens, and forms an image of light flux from anobject on the imaging surface of the imaging device. The imaging deviceis a charge coupled device (CCD) or a complementary metal oxidesemiconductor (CMOS), and outputs an image of an object formed on theimaging surface. The image processor produces video image data in apredetermined file format for every predetermined period from imagescontinuously generated by the imaging device, and outputs the videoimage data as imaging data. Alternatively, the image processor producesstill image data in a predetermined file format from an image generatedby the imaging device, and outputs the still image data as imaging data.

The microphone 26 is a sound collector configured to obtain sounduttered by a user, and convert the sound into sound data. The microphone26 is configured to obtain sound input of a user, and the sound input ofthe user obtained by the microphone 26 is converted into sound data,which is transmitted to the server apparatus 3 via the communication I/F21.

The processor 27 is a processing unit that loads the operating systemprogram, the driver program and the application program stored in thestorage device 22 into the memory, and executes the commands containedin the loaded programs. The processor 27 is, for instance, an electroniccircuit, such as a central processing unit (CPU), a micro processingunit (MPU), a digital signal processor (DSP), and a graphics processingunit (GPU), or a combination of various electronic circuits. Theprocessor 27 may be implemented by an integrated circuit, such as anapplication specific integrated circuit (ASIC), a programmable logicdevice (PLD), a field programmable gate array (FPGA), and a microcontroller unit (MCU). In FIG. 3 , the processor 27 is illustrated as asingle component, however, the processor 27 may be a set of physicallyseparate processors.

The processor 27 executes various commands contained in the controlprogram, thereby functioning as a generator 271, an executor 272, atransmitter 273, a receiver 274, and a reproducer 275. The functions ofthe generator 271, the executor 272, the transmitter 273, the receiver274, and the reproducer 275 will be described below.

Further, processor 27 and the functionality of sub-elements generator271, executor 272, transmitter 273, receiver 274 and reproducer 275 maybe implemented using circuitry or processing circuitry which includesgeneral purpose processors, special purpose processors, integratedcircuits, ASICs, conventional circuitry and/or combinations thereofwhich are configured or programmed to perform the disclosedfunctionality. Processors are considered processing circuitry orcircuitry as they include transistors and other circuitry therein. Theprocessor 27 may be a programmed processor which executes a programstored in a memory. In the disclosure, the circuitry, units, or meansare hardware that carry out or are programmed to perform the recitedfunctionality. The hardware may be any hardware disclosed herein orotherwise known which is programmed or configured to carry out therecited functionality. When the hardware is a processor which may beconsidered a type of circuitry, the circuitry, means, or units are acombination of hardware and software, the software being used toconfigure the hardware and/or processor.

(Various Tables)

FIGS. 4A to 4C are tables illustrating an example of data structures ofa user table T1, an object table T2, and an effect instruction historytable T3 stored in the storage device 22. Note that the user table T1,the object table T2, and the effect instruction history table T3 may bestored in a storage device 32 of the server apparatus 3. In this case,the terminal 2 may obtain (receive) the latest user table T1, objecttable T2, and effect instruction history table T3 at a predeterminedtiming to store the tables in the storage device 22.

(User Table T1)

FIG. 4A is an example of a data structure of the user table T1 formanaging the users (the stream user and viewing users) who participatein the video stream system 1. In the user table T1, for each user, auser ID, a name, a character object and an object in possession arestored in association with each other. In the user table T1, a coin inpossession (information showing the total amount of “coins” having avirtual monetary value possessed by a user) of a user and/or user pointsmay be stored in association with the user ID of the user.

The user ID is an example of identifying data to uniquely identify eachuser. The name is an example of data showing the name of each user.

The character object is, for instance, a model ID to identify model datafor generating an animation of a character object. The model data isstored in the storage device 22 in association with the model ID. Themodel data may be a three-dimensional model data for generating athree-dimensional animation, or may be two-dimensional model data forgenerating a two-dimensional model data. The model data includes, forinstance, rig data (so-called “skeleton data”) showing the skeletalframe of the face of a character object and parts other than the face,and surface data showing the shape and texture of the surface of thecharacter object. The model data may include multiple pieces of modeldata different from each other. The multiple pieces of model data mayhave respective pieces of rig data different from each other, or mayhave the same rig data. The multiple pieces of model data may haverespective pieces of surface data different from each other, or may havethe same surface data.

The object in possession is an object ID showing the object possessed bya user. For instance, the object in possession may be an object which ispossessed by a user consuming “coins” having a virtual monetary valueusing the purchase function in the video stream system 1. For instance,a stream user operates the terminal 2 during streaming of a characterstream screen (during transmission of character video data), thus anobject in possession (attachment object) can be attached to a characterobject which is included in the character stream screen and correspondsto the stream user. Also, a stream user operates the terminal 2 duringstreaming of a character stream screen (during transmission of charactervideo data), thus an object in possession (wall paper object) can bedisposed on the background of a character object which is included inthe character stream screen, and corresponds to the stream user.

In the user table T1, for each user, object display information inassociation with the user may be stored. For instance, the objectdisplay information is an object ID showing an attachment object whichis displayed on the character stream screen in association with acharacter object corresponding to the stream user.

(Object Table T2)

FIG. 4B is an example of a data structure of the object table T2 formanaging objects, one of which is selected as a gift object. In theobject table T2, for each object, an object ID, image information, ararity and an arrangement position are stored in association with eachother.

The object ID is an example of identifying data to uniquely identify anobject. The image information is one or more still images correspondingto an object. The image information may also be one or more types ofvideo images corresponding to an object. The rarity is informationshowing the degree of rarity of an object. The arrangement position isinformation showing the position where image information on an object isdisplayed. Note that when the display position and the display range ofa character object are defined, information showing a relative positionto the character object may be stored as the arrangement position.

Each object is classified into multiple types. The object includes, forinstance, an effect object showing an effect gift, a normal objectshowing a normal gift, an attachment object showing an attachment gift,and a message object showing a message gift. Hereinafter, the imageinformation and the arrangement position according to the type of anobject will be described.

The effect object is an object that gives an effect on the impression ofthe whole character stream screen. The effect object is, for instance,an object representing confetti. When the effect object is an objectrepresenting confetti, an image showing multiple sheets of paper isstored as image information.

Information showing “space” is stored as an arrangement position of aneffect object. For instance, an object representing confetti isdisplayed on the whole character stream screen. Also, the effect objectmay be displayed overlapping with a character object. Unlike theattachment object described below, the effect object is displayedwithout being associated with a specific part of the character. In thismanner, the terminal 2 of the video stream system 1 displays an effectobject according to instructions given by a viewing user, thereby makingit possible to change the impression of the whole character streamscreen as compared with before the effect object is displayed.

A normal object is, for instance, an object representing a plush toy, abouquet, an accessory, or an article suitable for a gift or a present.Information showing “space” is stored as an arrangement position of anormal object. For instance, a normal object is associated withinformation on a predetermined movement route, and the normal object isdisplayed, which moves along the predetermined movement route in thecharacter stream screen. Information showing “space”, stored as anarrangement position of a “normal object” may be classified intomultiple types. The “space” of multiple types is, for instance, “thecentral space” (the area at the center of the display screen when thescreen is divided into thirds horizontally), “the left space” (the areaon the left side of the display screen when the screen is divided intothirds horizontally), and “the right space” (the area on the right sideof the display screen when the screen is divided into thirdshorizontally). Alternatively, “space” of multiple types is, forinstance, “the central space” (the area at the center of the displayscreen when the screen is divided into thirds vertically), “the upperspace” (the area on the upper side of the display screen when the screenis divided into thirds vertically), and “the lower space” (the area onthe lower side of the display screen when the screen is divided intothirds vertically). In this case, a movement route in association with anormal object is set in the “space” of the type in association with thearrangement position of the normal object. For instance, wheninformation showing “the right space” is stored for a normal object, thenormal object is associated with information on a movement route formoving in the area on the right side of the screen when the displayscreen is divided into thirds horizontally. Note that a normal objectmay be displayed overlapping with a character object. In this case,unlike the attachment object described below, a normal object isdisplayed without being associated with a specific part of the characterobject.

When a normal object is displayed overlapping with a character object,the normal object may be displayed overlapping with the “parts otherthan the “head” including the “face”” of the character object, forinstance. In this case, the normal object is displayed withoutoverlapping with the “head” of the character object. Alternatively, anormal object may be displayed overlapping with the “parts other thanthe “upper half body” including the “face”” of the character object. Inthis case, the normal object is displayed without overlapping with the“upper half body” of the character object.

The attachment object is an object which is displayed on a characterstream screen in association with a specific part (attachment position)of a character object. The specific part is, for instance, the forwardleft side, the forward right side, the rearward left side, the rearwardright side, the central front side, the central rear side, the left eye,the right eye, the left ear, the right ear, or the whole hair in thehead of a character object. Alternatively, the specific part may be athumb, a ring finger, a wrist, an elbow, a shoulder, an upper arm, awhole hand, or a whole arm.

An attachment object in association with a specific part of a characterobject is displayed on the character stream screen so as to be incontact with the specific part of the character object. Alternatively,an attachment object in association with a specific part of a characterobject may be displayed on the character stream screen so as to coverpart or all of the specific part of the character object. The specificpart may be identified by three-dimensional location information showinga position in a three-dimensional coordinate space, or may also be inassociation with information on location in a three-dimensionalcoordinate space.

The image information on an attachment object is, for instance, imageinformation representing an accessory (a headband, a necklace or anearring), clothes (a T-shirt or a one-piece dress), a costume to beattached to a character object, or anything other than those, attachableto a character object.

Information showing an attachment part is stored as an arrangementposition of an attachment object, the information indicating which partof a character object is in association with the attachment object. Forinstance, when the attachment object is a “headband”, informationshowing the “head” of a character object is stored as the arrangementposition of the attachment object. In addition, when the attachmentobject is a “T-shirt”, information showing the “trunk” of a characterobject is stored as the arrangement position of the attachment object.

Information showing multiple attachment parts in a three-dimensionalcoordinate space may be stored as the arrangement position of anattachment object. For instance, when the attachment object is a“headband”, information showing two parts, that is, the “rear left sideof head” and the “rear right side of head” of a character object may bestored as the arrangement position of the attachment object. Thus, theattachment object representing a “headband” is displayed so as to beattached to both the “rear left side of head” and the “rear right sideof head” of a character object.

When multiple types of attachment objects having a common attachmentposition are attached to a character object, the multiple types ofattachment objects are attached to the character object at differenttimes. Thus, the multiple types of attachment objects having a commonattachment part are not attached to the character object at the sametime. For instance, when “head” is stored as the attachment position ofan attachment object showing a “headband” and an attachment objectshowing a “hat”, the attachment object showing a “headband” and theattachment object showing a “hat” are not displayed on the head of thecharacter object at the same time.

In the object table T2, a display time according to the type of anobject may be stored in association with the object ID of the object.For instance, the display time of an attachment object, longer than thedisplay time of an effect object and the display time of a normalobject, may be stored. For instance, when “60 seconds” is stored as thedisplay time of an attachment object, “five seconds” may be stored asthe display time of an effect object, and “10 seconds” may be stored asthe display time of a normal object.

(Effect Instruction History Table T3)

FIG. 4C is an example of a data structure of an effect instructionhistory table T3 for managing information which shows effectinstructions transmitted from the viewing terminal 2 b. In the effectinstruction history table T3, for each user, a viewing user ID, receivedate/time and points are stored in association with the other.

The viewing user ID is an example of identifying data to uniquelyidentify a viewing user who has input effect instructions. The receivedate/time is information showing the date/time when effect instructionswere received from the viewing terminal 2 b.

The points are numeric information showing the value of a gift objectcorresponding to effect instructions. For instance, the points indicatea value which corresponds to “coins” having a virtual monetary valueconsumed when a stream user obtains a gift object.

Every time receiving effect instructions, the stream terminal 2 aretrieves the viewing user ID and points included in the received effectinstructions, and stores the retrieved viewing user ID, the receivedate/time, and points of the effect instructions in the effectinstruction history table T3 in association with each other as a newrecord. Every time receiving effect instructions from the serverapparatus 3, given by a viewing user of another viewing terminal 2 b,the viewing terminal 2 b retrieves the viewing user ID and pointsincluded in the received effect instructions, and stores the retrievedviewing user ID, receive date/time, and points of the effectinstructions in the effect instruction history table T3 in associationwith each other as a new record. Every time receiving effectinstructions input by a viewing user of the viewing terminal 2 b, theviewing terminal 2 b stores the viewing user ID of the viewing user,points corresponding to a designated specific gift object, and the inputdate/time (transmission date/time) of the effect instructions in theeffect instruction history table T3 in association with each other as anew record.

Hereafter, the functions of the generator 271, the executor 272, thetransmitter 273, the receiver 274, and the reproducer 275 will bedescribed.

(Generator 271)

Referring to FIGS. 5A and 5B, an example of the function of thegenerator 271 will be described. As illustrated in FIGS. 5A and 5B, theimaging device 25 of the terminal 2 held by a stream user U is installedin the terminal 2 so that the face of the stream user U looking at thedisplay screen of the display unit 23 is in an image capture directionD, for instance. The imaging device 25 continuously captures the face ofthe stream user U in the image capture direction D to obtain imagingdata of the face of stream user U, and outputs the imaging data to theprocessor 27. The imaging device 25 may obtain imaging data by capturingthe parts other than the face of the stream user U, for instance, thehead, the arms, the hands (including the fingers), the chest, the trunk,the legs, and parts other than those. Alternatively, the imaging device25 may be a 3D camera that can detect the depth of the human face.

The generator 271 generates face motion data as needed as time elapsesbased on the imaging data continuously output by the imaging device 25,the face motion data being digital representation of the motion of theface of the stream user U. The face motion data may be generated foreach predetermined sampling time interval. In this manner, the facemotion data generated by the generator 271 enables the face motion(change in the facial expression) of the stream user U to be digitallyrepresented in time series.

The generator 271 may generate body motion data along with face motiondata or separately from face motion data, the body motion data beingdigital representation of the positions and directions of the parts (thehead, the arms, the hands (including the fingers), the chest, the trunk,the legs, and parts other than those) of the stream user U.

The body motion data may be generated based on the detection informationfrom a publicly known motion sensor attached to the stream user U. Inthis case, the communication I/F 21 of the terminal 2 has apredetermined communication circuit to obtain the detection informationfrom the motion sensor attached to the stream user U by wirelesscommunication. The generator 271 then generates body motion data basedon the detection information obtained by the communication I/F 21. Thebody motion data may be generated for each predetermined sampling timeinterval. Thus, the body motion data generated by the generator 271 candigitally represent the motion of the body of the stream user U in timeseries.

The generator 271 suspends generation of face motion data and/or bodymotion data according to instructions for executing a game given by thestream user, and when the game executed by the later-described executor272 ends, resumes the generation of the face motion data and/or the bodymotion data.

The generation of body motion data based on the detection informationfrom a motion sensor attached to the stream user U may be performed, forinstance, in a photo studio. In this case, the photo studio may beprovided with a base station, a tracking sensor, and a display. The basestation is, for instance, a multi-axis laser emitter. The motion sensorattached to the stream user U may be, for instance, Vive Trackerprovided by HTC CORPORATION, and the base station may be, for instance,the one provided by HTC CORPORATION.

Alternatively, a supporter computer may be installed in another roomadjacent to the photo studio. The display of the photo studio may beconfigured to display information received from the support computer.The server apparatus 3 may be installed in the same room in which thesupporter computer is installed. The room in which the supportercomputer is installed and the photo studio may be separated by a glasswindow. In this case, an operator of the supporter computer can visuallyrecognize the stream user. The supporter computer may be configured toallow the setting of various types of devices provided in the photostudio to be changed in response to an operation of the operator. Forinstance, the supporter computer is capable of changing the setting ofan interval of scanning performed by the base station, the setting ofthe tracking sensor, and various settings of various types ofinstruments other than those. The operator may input a message into thesupporter computer, and the input message may be displayed on a displayof the photo studio.

(Executor 272)

The executor 272 executes various commands contained in the controlprogram (game program) stored in the storage device 22 according toinstructions for executing a game given by the stream user, starts thegame, and displays a game stream screen containing the screen of thestarted game on the display unit 23. The executor 272 progresses atleast two types of games based on the various commands contained in thecontrol program and the game operation input by the stream user, anddisplays the game screen of the game in progress on the display unit 23.

The executor 272 starts the first game between the at least two types ofgames according to instructions for executing the game given by thestream user, and starts the second game upon the end of the first game.When ending all types of games, the executor 272 notifies the generator271 of the end of the games.

(Transmitter 273)

When face motion data and/or body motion data are generated by thegenerator 271, the transmitter 273 transmits character video data to theserver apparatus 3 via the communication I/F 21, the character videodata including the generated face motion data and/or body motion data,and the stream user ID stored in the storage device 22. Hereinafter,face motion data and body motion data may be collectively referred to asmotion data.

Also, when a game is executed by the executor 272, the transmitter 273transmits game video data to the server apparatus 3 via thecommunication I/F 21, the game video data including display data todisplay a video on the game screen of the game being executed, and thestream user ID stored in the storage device 22.

The transmitter 273 may transmit the sound data of the stream user Uobtained by the microphone 26 to the server apparatus 3 in real time viathe communication I/F 21. Note that the transmitter 273 may includesound data synchronized with the motion data in the character videodata.

The transmitter 273 transmits a display request for displaying responseinformation on the character stream screen and a display request fordisplaying a gift object on the character stream screen to the serverapparatus 3 via the communication I/F 21, the response information beinginput by a viewing user operating the input device 24, the gift objectcorresponding to the gift object information described below. Theresponse information is information on comment data, evaluation dataand/or gift object, and the details will be described below. Note thatthe display request includes a viewing user ID and the points of a giftobject, stored in the storage device 22.

The transmitter 273 transmits an end request to give instructions to enda stream event to the server apparatus 3 via the communication I/F 21.For instance, the stream user performs a predetermined tap operation onthe display screen of the display unit 23 of the stream terminal 2 a,thus the input device 24 instructs the transmitter 273 to end the streamevent. Note that the end request includes a stream user ID stored in thestorage device 22.

(Receiver 274)

The receiver 274 receives video stream data transmitted from the serverapparatus 3, and request stream data including various display requestsvia the communication I/F 21. The video stream data includes charactervideo stream data including at least the motion data of the stream userand the user ID of the stream user, and game video stream data showingthe screen of the game being played by the stream user. Note that thedetails of the video stream data and the request stream data will bedescribed below.

When the request stream data includes a display request for apredetermined specific gift object, the receiver 274 identifies thedisplay request as the effect instructions, retrieves the viewing userID and points included in the identified effect instructions, and storesthe retrieved viewing user ID, receive date/time, and points of theeffect instructions in the effect instruction history table T3 inassociation with each other as a new record.

(Reproducer 275)

The reproducer 275 generates drawing data to display a character streamscreen based on the motion data generated by the generator 271 and/orthe motion data included in the character video stream data received bythe receiver 274, and displays the character stream screen on thedisplay unit 23, based on the generated drawing data.

The reproducer 275 generates an animation of the character object basedon the motion data. For instance, when motion data is generated by thegenerator 271, the reproducer 275 retrieves the model ID of a characterobject from the user table T1, the character object being associatedwith a user ID stored in the storage device 22. Also, when the motiondata is included in the character video stream data received by thereceiver 274, the reproducer 275 retrieves the model ID of a characterobject in association with a user ID included in the stream data fromthe user table T1.

Next, the reproducer 275 reads model data in association with theretrieved model ID from the storage device 22. The reproducer 275 thengenerates an animation of the character object based on the read modeldata and motion data.

When the motion data includes face motion data, the reproducer 275generates an animation of the character object so that the facialexpression of the character object changes based on the face motiondata. Thus, the reproducer 275 can generate an animation of thecharacter object which moves in synchronization with the facialexpression motion of the stream user, based on the read model data andface motion data.

When the motion data includes face motion data and body motion data, thereproducer 275 generates an animation of the character object whichmoves in synchronization with the facial expression and the body motionof the stream user, based on the read model data, face motion data andbody motion data.

The reproducer 275 generates a character stream screen which displays avideo image including the generated animation of the character object,and a background image showing the background, generated usingbackground data stored in the storage device 22. When the sound data ofthe stream user is obtained by the microphone 26 or when the sound dataof the stream user is included in the character video stream data, thereproducer 275 may synthesize the sound (of the stream user) generatedbased on the sound data with the generated video image. In this manner,the reproducer 275 generates an animation of the character object whichmoves in synchronization with the facial expression and the body motionof the stream user, and can generate a character stream screen in whichthe sound of the stream user is synthesized with the animation.

Alternatively, the reproducer 275 may attach an object in possession(for instance, an attachment object) of the stream user to a characterobject according to a request of the stream user. For instance, wheninstructions to attach an attachment object to the character object ofthe stream user are given by the stream user operating the terminal 2around the period of the stream event, the reproducer 275 attaches theattachment object to the character object of the stream user, based onthe display request.

In addition, when the request stream data includes a display request fora gift object, the reproducer 275 identifies the information to beincluded in the character stream screen according to the displayrequest.

When the identified information is the object ID of a specific effectobject, the reproducer 275 refers to the object table T2 to retrieve astill image or a video image (image information) of the effect object inassociation with the object ID of the specific effect object, andgenerates a character stream screen including the retrieved still imageor video image. For instance, when a display request for an effect giftshowing confetti or fireworks is made, the reproducer 275 generates acharacter stream screen including a video image of an effect objectrepresenting confetti or fireworks.

When the identified information is the object ID of a normal object, thereproducer 275 refers to the object table T2 to retrieve a still imageor a video image (image information) and its arrangement position of thenormal object in association with the object ID of the normal object.Next, the reproducer 275 generates a character stream screen includingthe still image or the video image of the normal object disposed at theposition indicated by the arrangement position.

The reproducer 275 may generate a character stream screen including avideo image of a normal object which moves in the display area of thecharacter stream screen. For instance, for a normal object, thereproducer 275 may generate a character stream screen including a videoimage of the normal object which falls from an upper position to a lowerposition of the stream screen. In this case, the normal object may bedisplayed in the display area of the character stream screen during theperiod from start of falling until the normal object falls to the lowerend of the character stream screen, and after the normal object falls tothe lower end of the character stream screen, the normal object maydisappear from the character stream screen.

Note that the movement route of the normal object may be a route in adirection from the left to the right, a direction from the right to theleft, a direction from the upper left to the lower left, or a directionother than those on the character stream screen, or may be a route alonga straight-line path, a circular path, an elliptic path, a helical path,or a path other than those.

When the identified information is the object ID of a specificattachment object, the reproducer 275 refers to the object table T2 toretrieve the image information and arrangement position of theattachment object in association with the object ID of the attachmentobject. Next, the reproducer 275 generates a character stream screenincluding the image information of the attachment object attached to theattachment part indicated by the arrangement position.

For instance, when the specific attachment object is “headbandrepresenting cat ears”, the reproducer 275 generates a character streamscreen including a character object in which the attachment objectrepresenting “headband” is attached to the head (the arrangementposition in association with the object ID of “headband”). Note that theattachment object may be displayed on the character stream screen tomove while following the motion of the attachment part (arrangementposition) of the character.

Note that when the gift object included in the generated characterstream screen is a predetermined specific gift object (for instance,psyllium), the reproducer 275 deletes from the effect instructionhistory table T3 the information corresponding to the effectinstructions for the specific gift object among the information (viewinguser ID, receive date/time, and points) on the effect instructionsstored in the effect instruction history table T3.

In addition, the reproducer 275 generates drawing data to display a gamestream screen including the game screen of a game being executed by thestream user, based on the game video stream data received by thereceiver 274, and displays a game stream screen on the display unit 23,based on the generated drawing data.

When the request stream data includes a display request for a specificgift object during display of the game stream screen, the reproducer 275identifies the display request as the effect instructions, andidentifies the information to be included in the character stream screenaccording to the display request.

(Server Apparatus 3)

FIG. 6 is a diagram illustrating an example of a schematic configurationof the server apparatus 3.

The server apparatus 3 generates character video stream data based onthe motion data from the stream terminal 2 a and/or the responseinformation from the viewing terminal 2 b, and streams (transmits) thestream data to one or more viewing terminals 2 b. For this purpose, theserver apparatus 3 includes a communication I/F 31, a storage device 32,and a processor 33.

The communication I/F 31 is implemented as hardware, firmware,communication software, such as a TCP/IP driver and a PPP driver, or acombination thereof. The server apparatus 3 can transmit data to anotherdevice and receive data from another device via the communication I/F31.

The storage device 32 is, for instance, a semiconductor memory unit,such as a ROM, a RAM. The storage device 32 may be, for instance, amagnetic disk, an optical disc, or various storage devices other thanthose, capable of storing data. The storage device 32 stores anoperating system program, a driver program, an application program anddata which are used for processing in the processor 33. In an exemplaryimplementation, storage device 32 is a non-transitory computer readablemedium that stores computer executable instructions for execution byprocessor 33.

The processor 33 is a processing unit that loads the operating systemprogram, the driver program and the application program stored in thestorage device 32 into the memory, and executes the commands containedin the loaded programs. The processor 33 is, for instance, an electroniccircuit, such as a CPU, an MPU, a DSP, and a GPU, or a combination ofvarious electronic circuits. The processor 33 may be implemented by anintegrated circuit, such as an ASIC, a PLD, an FPGA, and an MCU. In FIG.6 , the processor 33 is illustrated as a single component, however, theprocessor 33 may be a set of physically separate processors.

The processor 33 executes various commands contained in the controlprogram, thereby functioning as a server receiver 331, and a serverstreamer 332. Further, processor 33 and the functionality ofsub-elements server receiver 331 and server distributor 332 may beimplemented using circuitry or processing circuitry which includesgeneral purpose processors, special purpose processors, integratedcircuits, ASICs, conventional circuitry and/or combinations thereofwhich are configured or programmed to perform the disclosedfunctionality. Processors are considered processing circuitry orcircuitry as they include transistors and other circuitry therein. Theprocessor 33 may be a programmed processor which executes a programstored in a memory. In the disclosure, the circuitry, units, or meansare hardware that carry out or are programmed to perform the recitedfunctionality. The hardware may be any hardware disclosed herein orotherwise known which is programmed or configured to carry out therecited functionality. When the hardware is a processor which may beconsidered a type of circuitry, the circuitry, means, or units are acombination of hardware and software, the software being used toconfigure the hardware and/or processor.

(Server Receiver 331)

The server receiver 331 receives video data via the communication I/F31, the video data being transmitted from the stream terminal 2 a. Thevideo data is character video data or game video data. In addition, theserver receiver 331 receives various requests (display requests and endrequests) via the communication I/F 31, the various requests beingtransmitted from one or more viewing terminals 2 b.

(Server Streamer 332)

The server streamer 332 streams stream data to the stream terminal 2 a,and one or more viewing terminals 2 b via the communication I/F 31, thestream data including various types of data (such as the motion data(and the user ID), the motion data and sound data (and the user ID),video data of the screen of the game, a display request, and an endrequest) received by the server receiver 331.

Examples of Various Screens

Hereinafter, examples of various screens displayed on the display unit23 of each terminal 2 of a stream user and viewing users will bedescribed with reference to FIGS. 7A and 7B to FIGS. 16A and 16B.

FIG. 7A is a view illustrating an example of a character stream screen800 displayed on the display unit 23 of the stream terminal 2 a. Thecharacter stream screen 800 includes a character object 801, a gamestart button 802, and a response information display area 803. FIG. 7Bis a view illustrating an example of a character stream screen 810displayed on the display unit 23 of the viewing terminal 2 b. Thecharacter stream screen 810 includes a character object 801, anevaluation button 811, a gift button 812, a comment button 813, and aresponse information display area 814.

The stream terminal 2 a executes processing to transmit the charactervideo data by the transmitter 273 and processing to display thecharacter stream screen 800 by the reproducer 275 concurrently (inparallel) at the same time as the start of video streaming. Note that inthe stream terminal 2 a, a stream event of a stream user starts andvideo streaming starts in response to selection by the stream user to apredetermined video stream start button displayed on the display unit23.

Information showing one or more stream users during streaming isreceived from the server apparatus 3 by the receiver 274 of the viewingterminal 2 b, and a video selection screen to select from one or morestream users during streaming is displayed on the display unit 23 by thereproducer 275. Next, the transmitter 273 of the viewing terminal 2 btransmits a viewing start request to the server apparatus 3 via thecommunication I/F 21, the viewing start request including informationshowing a stream user selected from one or more stream users duringstreaming displayed in the video selection screen in response to anoperation of the input device 24 by a viewing user.

The server receiver 331 of the server apparatus 3 receives the viewingstart request via the communication I/F 31 which is transmitted from theviewing terminal 2 b. The server streamer 332 of the server apparatus 3streams the video stream data of a stream user via the communication I/F31 to the viewing terminal 2 b which has transmitted the viewing startrequest, the stream user being shown by the information included in theviewing start request received by the server receiver 331. The receiver274 of the viewing terminal 2 b then receives from the server apparatus3 via the communication I/F 21 the video stream data of the stream usershown by the information included in the viewing start request.

When the video stream data received by the receiver 274 is charactervideo stream data, the reproducer 275 of the viewing terminal 2 bdisplays the character stream screen 810 based on the received charactervideo stream data. When the video stream data received by the receiver274 is game video stream data, the reproducer 275 of the viewingterminal 2 b displays the later-described game stream screen based onthe received game video stream data. Note that the server apparatus 3registers (stores in the storage device 32) the viewing user of theviewing terminal 2 b, which has transmitted the viewing start request,as the viewing user in viewing.

The transmitter 273 of the viewing terminal 2 b transmits to the serverapparatus 3 via the communication I/F 21 a viewing end request accordingto an operation of the input device 24 by a viewing user, thus endsreceiving of the video stream data, and ends display of the characterstream screen 810 or the game stream screen. Note that for the viewinguser of the viewing terminal 2 b which has transmitted the viewing endrequest, the server apparatus 3 cancels the registration as the viewinguser in viewing (deletes the information which is stored in the storagedevice 32 and shows “viewing user in viewing”).

Hereinafter, the display objects displayed on the character streamscreen 800 and the character stream screen 810 will be described.

The character object 801 is an object image generated based on themotion data of the stream user. When the motion data includes facemotion data, the facial expression of the character object 801 changesin synchronization with the facial expression motion of the stream user.When the motion data includes body motion data, a corresponding part ofthe character object 801 moves in synchronization with the body motionof the stream user.

The game start button 802 is an object image to give instructions forstarting progress of a game. When the input device 24 is a touch panel,upon a tap operation performed by a stream user on the display area ofthe game start button 802, the game start button 802 is selected. Thegame start button 802 may not be displayed in a visually recognizablemanner. When the game start button 802 is selected by a stream user, theinput device 24 notifies the executor 272 of instructions for executinga game. When receiving instructions for executing a game from the inputdevice 24, the executor 272 executes various commands contained in thecontrol program (game program) stored in the storage device 22, startsthe game, and displays a game stream screen containing the screen of thestarted game on the display unit 23.

The response information display area 803 includes the responseinformation (information on comment data, evaluation data and/or giftobject) transmitted from each viewing terminal 2 b during display of thecharacter stream screen 810.

In the example of the response information display area 803 illustratedin FIG. 7A, it is shown that comment data indicating a comment saying“It's cute” is transmitted from the viewing terminal 2 b of a viewinguser named “user A”. In addition, it is shown that evaluation data istransmitted from the viewing terminal 2 b of a viewing user named “userB”. Furthermore, it is shown that a name gift object “bear-san” isselected from the viewing terminal 2 b of a viewing user named “user C”.

The evaluation button 811 is an object image to give instructions fortransmitting evaluation data related to the character object 801included in the character stream screen 810 or the stream user involvedin the character object 801. When the input device 24 is a touch panel,upon a tap operation performed by a viewing user on the display area ofthe evaluation button 811, the evaluation button 811 is selected. Theevaluation button 811 may not be displayed in a visually recognizablemanner. When the evaluation button 811 is selected by a viewing user whois viewing the character stream screen 810, the transmitter 273 of theviewing terminal 2 b transmits a display request to the server apparatus3 via the communication I/F 21, the display request including evaluationdata indicating “positive evaluation for the character object 801included in the character stream screen 810” has been made or evaluationdata indicating “positive evaluation for the stream user involved in thecharacter object 801 included in the character stream screen 810” hasbeen made. The server receiver 331 of the server apparatus 3 may storethe received evaluation data in the storage device 32, or the serverstreamer 332 of the server apparatus 3 may transmit the receivedevaluation data to the stream terminal 2 a.

Note that the evaluation button 811 may be an object image to giveinstructions for transmitting a display request including evaluationdata indicating “negative evaluation for the character object 801included in the character stream screen 800” has been made or evaluationdata indicating “negative evaluation for the stream user involved in thecharacter object 801 included in the character stream screen 800” hasbeen made. Also, the character stream screen 810 may include multipletypes of evaluation buttons 811 (for instance, two types of evaluationbuttons: one is for transmitting positive evaluation data, and the otheris for transmitting negative evaluation data).

When the character stream screen 810 is displayed on multiple viewingterminals 2 b, aggregate information obtained by aggregating evaluationdata transmitted from each viewing terminal 2 b may be included in thecharacter stream screen 800 and/or the character stream screen 810. Forinstance, the server apparatus 3 may count the number of pieces ofevaluation data transmitted from each of the multiple viewing terminals2 b and may include the number of pieces of evaluation data in thecharacter stream screen 800 and/or the character stream screen 810. Theaggregate information is not limited to the number of pieces ofevaluation data and may also be, for instance, information on timeinterval when the evaluation data is transmitted. Note that the periodof aggregate is the period from the start of a stream event to thepresent time, the period from the start of display of the characterstream screen 800 to the present time, the period from the start ofstreaming of the character stream screen 810 to the present time, apredetermined period (for instance, the period from 21:00 to 24:00), orthe like. Also, multiple periods of aggregate may be set. Whenevaluation data is transmitted to the stream terminal 2 a by the serverapparatus 3, aggregate processing of evaluation data may be performed bythe stream terminal 2 a. In this case, processing to include aggregateinformation in the character stream screen 800 may be performed by thestream terminal 2 a, and processing to include aggregate information inthe character stream screen 810 may be performed by the viewing terminal2 b which displays the character stream screen 810.

The gift button 812 is an object image to give instructions fordisplaying a selection screen 820 to select a gift object to bedisplayed on the character stream screen 800 and the character streamscreen 810. When the input device 24 is a touch panel, upon a tapoperation performed by a viewing user on the display area of the giftbutton 812, the gift button 812 is selected. The gift button 812 may notbe displayed in a visually recognizable manner. When the gift button 812is selected by a viewing user who is viewing the character stream screen810, the selection screen 820 is displayed. The details of the selectionscreen 820 will be described below.

The comment button 813 is an object image to give instructions fordisplaying a comment input window to input a comment (character string)to be displayed on the character stream screen 800 and the characterstream screen 810. When the input device 24 is a touch panel, upon a tapoperation performed by a viewing user on the display area of the commentbutton 813, the comment button 813 is selected. The comment button 813may not be displayed in a visually recognizable manner. When the commentbutton 813 is selected by a viewing user who is viewing the characterstream screen 810, a comment input window is displayed to besuperimposed on the character stream screen 810.

The comment input window is displayed only on the display unit 23 of theviewing terminal 2 b of a viewing user who has selected the commentbutton 813, and the comment input window and a character string beinginput in the comment input window are not displayed on the display unit23 of other viewing terminals 2 b. The input device 24 is operated by aviewing user, thus the transmitter 273 transmits a display request tothe server apparatus 3 via the communication I/F 21, the display requestincluding comment data showing a comment (character string) input in thecomment input window.

The server receiver 331 of the server apparatus 3 receives a displayrequest for response information from each viewing terminal 2 b duringdisplay of the character stream screen 810, and the server streamer 332of the server apparatus 3 transmits request stream data including theresponse information to any other viewing terminal 2 b other than theviewing terminal 2 b which has transmitted the display request. Thereproducer 275 of each viewing terminal 2 b during display of thecharacter stream screen 810 displays the character stream screen 810, inwhich the pieces of response information included in the request streamdata transmitted from the server apparatus 3 and the pieces of responseinformation transmitted to the server apparatus 3 are arranged in timeseries and included in the response information display area 814. Also,the server apparatus 3 transmits to the stream terminal 2 a the displayrequest for the response information included in the stream data fromeach viewing terminal 2 b, and the reproducer 275 of the stream terminal2 a displays the character stream screen 800 in which the pieces ofresponse information included in the request stream data transmittedfrom the server apparatus 3 are arranged in time series and included inthe response information display area 803.

Note that the server apparatus 3 may generate pieces of character videostream data for displaying the character stream screen 800 and thecharacter stream screen 810 in which the pieces of response informationfrom one or more viewing terminals 2 b during display of the characterstream screen 810 are arranged in chronological order of transmissionand included in the response information display area 803 and theresponse information display area 814 and may transmit correspondingpieces of character video stream data to the stream terminal 2 a andeach viewing terminal 2 b.

An upper limit number may be set to the number of pieces of responseinformation displayable on the response information display area 803 andthe response information display area 814. In the example of theresponse information display area 803 illustrated in FIG. 7A and theresponse information display area 814 illustrated in FIG. 7B, the upperlimit number of displayable pieces of response information is “3”. Whenthe number of pieces of response information to be displayed on eachterminal 2 exceeds the upper limit number which has been set, thereproducer 275 of each terminal 2 displays the character stream screen800 in which newly received three pieces of response information aresequentially included in the response information display area 803. Notethat the server apparatus 3 may generate pieces of character videostream data for displaying the character stream screen 800 and thecharacter stream screen 810 in which most recently received three piecesof response information are arranged in chronological order and includedin the response information display area 803 and the responseinformation display area 814 and may transmit corresponding pieces ofcharacter video stream data to the stream terminal 2 a and each viewingterminal 2 b.

Note that a publicly-known scroll bar may be displayed adjacent to theresponse information display area 803 and the response informationdisplay area 814. In this case, in response to an operation of thescroll bar performed by a stream user and a viewing user, responseinformation older than the response information displayed adjacent tothe response information display area 803 and the response informationdisplay area 814 is displayed on the response information display area803 and the response information display area 814.

FIG. 8A is a view illustrating an example of the selection screen 820displayed on the display unit 23. The selection screen 820 illustratedin FIG. 8A is displayed by the reproducer 275 of the viewing terminal 2b so as to be superimposed on the character stream screen 810. Theselection screen 820 may be displayed after the display of the characterstream screen 810 ends.

The selection screen 820 includes images and/or names showing one ormore candidate objects. In the example illustrated in FIG. 8A, imagesand names showing eight types of candidate objects are displayed on theselection screen 820. The number of candidate objects displayed on theselection screen 820 is not limited to eight. Note that when it is notpossible to include part of the images showing multiple candidateobjects in the selection screen 820, the reproducer 275 of the viewingterminal 2 may display a publicly-known scroll bar in the selectionscreen 820. In this case, in response to an operation of the scroll barperformed by a viewing user, an image showing a candidate object notcurrently displayed on the selection screen 820 is scroll-displayed inthe selection screen 820.

Each of the candidate objects indicates a gift object, and an imageshowing a candidate object is, for instance, an icon image or athumbnail image showing a gift object. Note that in the selection screen820, the images and/or names of the candidate objects may be classifiedinto the types of gift object (such as a free gift, a paid gift, anaccessory, support goods, appeal, and variety) and displayed. Note thata gift object belonging to the paid gift (hereinafter, may be referredto as a “paid gift object”) is purchasable by a viewing user consuming“coins” having a virtual monetary value. A gift object belonging to thefree gift is available by consuming points which are obtainable by, forinstance, viewing streaming data instead of consuming a monetary value.

When the input device 24 is a touch panel, in response to a tapoperation performed by a viewing user on the display area of an imageand/or a name showing a candidate object, the candidate object isselected. When a candidate object is selected by a viewing user, thetransmitter 273 of the viewing terminal 2 b sets information (forinstance, an object ID) showing the selected candidate object as giftobject information and transmits a display request to the serverapparatus 3 via the communication I/F 21, the display request being fordisplaying a gift object corresponding to the gift object information onthe stream screen. A display request for a gift object from the viewingterminal 2 b is transmitted to the server apparatus 3 in this manner,thus a gift object selected by a viewing user is presented to a streamuser or the character object 801 of a stream user, and the presentedgift object is displayed as in the character stream screen 800 and thecharacter stream screen 810 illustrated in FIG. 8B and FIG. 9A.

FIG. 8B is a view illustrating an example of the character stream screen800 displayed on the display unit 23 of the stream terminal 2 a after adisplay request for a gift object is transmitted. FIG. 9A is a viewillustrating an example of the character stream screen 810 displayed onthe display unit 23 of the viewing terminal 2 b after a display requestfor a gift object is transmitted.

In the same manner as the character stream screen 800 illustrated inFIG. 7A, the character stream screen 800 illustrated in FIG. 8B includesthe character object 801, the game start button 802, and the responseinformation display area 803. Furthermore, the character stream screen800 illustrated in FIG. 8B includes the gift objects 804 a and 804 b.

The server receiver 331 of the server apparatus 3 receives via thecommunication I/F 31 a display request including gift object information(such as an object ID) from each viewing terminal 2 b during display ofthe character stream screen 810, and the server streamer 332 transmitsrequest stream data including the received display request to the streamterminal 2 a via the communication I/F 31. The receiver 274 of thestream terminal 2 a receives the request stream data from the serverapparatus 3 via the communication I/F 21. When the received requeststream data includes a display request for a predetermined specific giftobject, the receiver 274 identifies the display request included in thereceived request stream data as the effect instructions. The receiver274 retrieves the viewing user ID and points included in the identifiedeffect instructions and stores the retrieved viewing user ID, receivedate/time, and points of the effect instructions in the effectinstruction history table T3 in association with each other as a newrecord.

The reproducer 275 of the stream terminal 2 a displays the gift objects804 a and 804 b which are object images corresponding to the gift objectinformation included in the request stream data (the gift objectinformation included in the display request) received by the receiver274. When the displayed gift object is a predetermined specific giftobject, the reproducer 275 deletes from the effect instruction historytable T3 the information corresponding to the effect instructions forthe displayed gift object (specific gift object) among the information(viewing user ID, receive date/time, and points) on the effectinstructions stored in the effect instruction history table T3.

In the same manner as the character stream screen 810 illustrated inFIG. 7B, the character stream screen 810 illustrated in FIG. 9A includesthe character object 801, the evaluation button 811, the gift button812, the comment button 813, and the response information display area814. Furthermore, the character stream screen 810 illustrated in FIG. 9Aincludes the same gift objects 804 a and 804 b as in FIG. 8B.

When the character stream screen 810 is displayed by any other viewingterminal 2 b other than the viewing terminal 2 b which has transmittedthe display request, the server receiver 331 of the server apparatus 3receives the display request including the gift object information fromthe other viewing terminal 2 b during display of the character streamscreen 810, and the server streamer 332 of the server apparatus 3transmits request stream data including the received display request toany other viewing terminal 2 b other than the viewing terminal 2 b whichhas transmitted the display request.

The receiver 274 of the other viewing terminal 2 b receives the requeststream data from the server apparatus 3 via the communication I/F 21.When the received request stream data includes a display request for apredetermined specific gift object, the receiver 274 identifies thedisplay request included in the received request stream data as theeffect instructions. The receiver 274 retrieves the viewing user ID andpoints included in the identified effect instructions and stores theretrieved viewing user ID, receive date/time, and points of the effectinstructions in the effect instruction history table T3 in associationwith each other as a new record.

The reproducer 275 of the other viewing terminal 2 b displays the giftobjects 804 c and 804 d which are object images corresponding to thegift object information included in the request stream data (the giftobject information included in the display request) received by thereceiver 274. When the displayed gift object is a predetermined specificgift object, the reproducer 275 deletes from the effect instructionhistory table T3 the information corresponding to the effectinstructions for the displayed gift object (specific gift object) amongthe information (viewing user ID, receive date/time, and points)corresponding to the effect instructions stored in the effectinstruction history table T3.

When the character stream screen 810 is displayed by the viewingterminal 2 b which has transmitted a display request, the viewingterminal 2 b displays the gift objects 804 c and 804 d which are objectimages corresponding to the information showing the candidate objectsselected by the viewing user who operates the viewing terminal 2 b.

The gift objects 804 c and 804 d displayed on the character streamscreen 800 and the character stream screen 810 may be displayed on thestream screens 800 and 810 for respective predetermined display times(for instance, 10 seconds and 15 seconds). Alternatively, on thecharacter stream screen 800 and the character stream screen 810, thegift objects 804 c and 804 d, which move along respective predeterminedmovement routes, may be displayed.

FIG. 9B is a view illustrating another example of the character streamscreen 800 displayed on the display unit 23 of the stream terminal 2 a.In the same manner as the character stream screen 800 illustrated inFIG. 7A, the character stream screen 800 illustrated in FIG. 9B includesthe character object 801, the game start button 802, and the responseinformation display area 803.

When the input device 24 is a touch panel as in the character streamscreen 800 illustrated in FIG. 9B, upon a tap operation performed by astream user on the display area of the game start button 802, the gamestart button 802 is selected. When the game start button 802 is selectedby a stream user, the input device 24 notifies the executor 272 ofinstructions for executing a game. When receiving instructions forexecuting a game from the input device 24, the executor 272 starts thegame which is implemented by executing various commands contained in thecontrol program (game program) stored in the storage device 22 anddisplays a first game stream screen including the screen of the startedgame on the display unit 23. A fishing game, which is implemented byexecuting various commands contained in the control program (gameprogram), will be described as an example.

FIG. 10A is a view illustrating an example of a first game stream screen830 displayed on the display unit 23 of the stream terminal 2 a. Thefirst game stream screen 830 includes a character object 831 a, atransportation object 831 b, and a response information display area803. FIG. 10B is a view illustrating an example of a first game streamscreen 840 displayed on the display unit 23 of the viewing terminal 2 b.The first game stream screen 840 includes a character object 831 a, atransportation object 831 b, an evaluation button 811, a gift button812, a comment button 813, and a response information display area 814.

As illustrated in FIG. 10A, the executor 272 of the stream terminal 2executes various commands contained in the control program (gameprogram) to start a fishing game, and then displays the first gamestream screen 830 including the screen of the first game. At the sametime, the transmitter 273 of the stream terminal 2 transmits game videodata to the server apparatus 3 via the communication I/F 21, the gamevideo data being for displaying a video on the screen of the first gamecurrently displayed.

When the server receiver 331 of the server apparatus 3 receives via thecommunication I/F 31 the game video data transmitted from the streamterminal 2 a, the server streamer 332 of the server apparatus 3transmits game video stream data to one or more viewing terminals 2 bvia the communication I/F 31, the game video stream data being containedin the game video data and including a video on the game screen of thefirst game being executed.

When the receiver 274 of each viewing terminal 2 b receives the gamevideo stream data from the server apparatus 3 via the communication I/F21, the reproducer 275 of the viewing terminal 2 b displays the firstgame stream screen 840 (FIG. 10B) based on the received video streamdata.

The character object 831 a is an object image showing the characterobject 801. In the same manner as the character object 801, thecharacter object 831 a may be generated based on the motion data of thestream user so as to digitally represent the motion of the face (changein the facial expression) of a stream user, the motion of the eyes, orthe motion of the body in time series. In addition, the character object831 a may also be a still image of a character object. Also, thecharacter object 831 a may be a profile image (still image) which isplaced on the top screen of a user in a website related to the videostream system.

The transportation object 831 b is an object image arranged at apredetermined position in the first game stream screen 830 and the firstgame stream screen 840, the object image representing a boat and beingdisplayed to float on the water surface. The transportation object 831 bmay also be an object which moves in a predetermined direction or alonga predetermined movement route. The transportation object 831 b may alsobe an object image representing a transportation other than a boat, andmay not be displayed on the first game stream screen 830 and the firstgame stream screen 840.

The response information display area 803 included in the first gamestream screen 830 illustrated in FIG. 10A has the same function as thatof the response information display area 803 included in the characterstream screen 800. The evaluation button 811, the gift button 812, thecomment button 813, and the response information display area 814included in the first game stream screen 840 illustrated in FIG. 10Bhave the same functions as those of the evaluation button 811, the giftbutton 812, the comment button 813, and the response information displayarea 814 included in the character stream screen 810.

The evaluation button 811 illustrated in FIG. 10B is an object image togive instructions for transmitting evaluation data on the gameplay of astream user in the first game stream screen 840. In addition, the giftbutton 812 illustrated in FIG. 10B is an object image to giveinstructions for displaying the selection screen 820 to select a giftobject. When the gift button 812 is selected by a viewing user who isviewing the first game stream screen 840, the selection screen 820 isdisplayed. In response to a tap operation performed by a viewing user onthe display area of an image and/or a name showing a candidate object inthe selection screen 820 displayed, the candidate object is selected.When a candidate object is selected by a viewing user, the transmitter273 of the viewing terminal 2 b sets information (for instance, anobject ID) showing the selected candidate object as gift objectinformation, and transmits a display request to the server apparatus 3via the communication I/F 21, the display request for displaying a giftobject corresponding to the gift object information on the streamscreen. The comment button 813 illustrated in FIG. 10B is an objectimage to give instructions for displaying a comment input window toinput a comment (character string) to be displayed on the first gamestream screen 830 and the first game stream screen 840.

FIG. 11A is a view illustrating another example of the first game streamscreen 830 displayed on the display unit 23 of the stream terminal 2 a.In the same manner as the first game stream screen 830 illustrated inFIG. 10A, the first game stream screen 830 illustrated in FIG. 11Aincludes the character object 831 a, the transportation object 831 b,and the response information display area 803. The response informationdisplay area 803 illustrated in FIG. 11A has the same function as thatof the response information display area 803 illustrated in FIG. 10A.

When the input device 24 is a touch panel as in the first game streamscreen 830 illustrated in FIG. 11A, upon a tap operation performed by astream user on a predetermined display area in the first game streamscreen 830, the input device 24 notifies the executor 272 ofinstructions for starting progress of the first game. The predetermineddisplay area may also be, for instance, the entire display area of thefirst game stream screen 830, or may be a partial area of the first gamestream screen 830 (for instance, a partial area of the entire displayarea of the first game stream screen 830 excluding the outer marginarea).

When receiving instructions for starting progress of the first game fromthe input device 24, the executor 272 displays a fishing rod object 832a which is placed to extend from the boat object 831 b, a fishing lineobject 832 b which is placed to extend from the fishing rod object 832 ato the water surface, and a mark object 832 c on the first game streamscreen 830. The fishing rod object 832 a and the fishing line object 832b are object images representing a fishing rod and a fishing line,respectively, and the mark object 832 c is an object image showing thepoint where the fishing line reaches the water surface.

At the same time when the first game stream screen 830 is displayed bythe executor 272, the transmitter 273 of the stream terminal 2 atransmits game video data to the server apparatus 3 via thecommunication I/F 21, the game video data being for displaying a videoon the screen of the first game currently displayed. When the serverreceiver 331 of the server apparatus 3 receives the game video datatransmitted from the stream terminal 2 a via the communication I/F 31,the server streamer 332 of the server apparatus 3 transmits game videostream data to one or more viewing terminals 2 b via the communicationI/F 31, the game video stream data being contained in the game videodata and including a video on the game screen of the first game beingexecuted. When the receiver 274 of each viewing terminal 2 b receivesthe game video stream data from the server apparatus 3 via thecommunication I/F 21, the reproducer 275 of the viewing terminal 2 bdisplays the first game stream screen 840 (FIG. 11B) based on thereceived video stream data.

FIG. 11B is a view illustrating another example of the first game streamscreen 840 displayed on the display unit 23 of the viewing terminal 2 b.The first game stream screen 840 includes the character object 831 a,the transportation object 831 b, the fishing rod object 832 a, thefishing line object 832 b, the mark object 832 c, the evaluation button811, the gift button 812, the comment button 813, and the responseinformation display area 814. The evaluation button 811, the gift button812, the comment button 813, and the response information display area814 illustrated in FIG. 11B have the same functions as those of theevaluation button 811, the gift button 812, the comment button 813, andthe response information display area 814 illustrated in FIG. 10B.

When the progress of the first game starts, the executor 272 of thestream terminal 2 a retrieves information showing a first game period(for instance, 10 seconds) pre-stored in the storage device 22. Forinstance, the executor 272 may use a pseudo-random number generated fromthe current clock counter value of the stream terminal 2 a serving as aseed to select an integer value at random with equal probability fromthe integer values in a predetermined numerical value range (forinstance, 5 seconds or greater and 15 seconds or less), and may set afirst game period to the integer value. When determining that the firstgame period has elapsed, the executor 272 ends the first game and startsthe second game. The executor 272 of the stream terminal 2 a ends thedisplay of the first game stream screen 830 along with the end of thefirst game, and displays the second game stream screen 850 on thedisplay unit 23 of the stream terminal 2 a.

FIG. 12A is a view illustrating another example of the first game streamscreen 830 displayed on the display unit 23 of the stream terminal 2 a.In the same manner as the first game stream screen 830 illustrated inFIG. 11A, the first game stream screen 830 illustrated in FIG. 12Aincludes the character object 831 a, the transportation object 831 b,the fishing rod object 832 a, the fishing line object 832 b, the markobject 832 c, and the response information display area 803. Theresponse information display area 803 illustrated in FIG. 12A has thesame function as that of the response information display area 803illustrated in FIG. 11A.

During the progress of the first game, the reproducer 275 of the streamterminal 2 a retrieves information (viewing user ID, receive date/time,and points) on the oldest effect instructions stored in the effectinstruction history table T3 for every predetermined time interval (forinstance, for every one second). The reproducer 275 retrieves the modelID of a character object in association with the retrieved viewing userID, from the user table T1. The reproducer 275 reads model data inassociation with the retrieved model ID from the storage device 22. Thereproducer 275 then generates a character object 833 a based on the readmodel data, and displays the generated character object 833 a, and atransportation object 833 b ridden by the character object 833 a. In theexample illustrated in FIG. 12A, the character object 833 a is formed bythe face image of a character object showing a viewing user, and a bodyobject showing the body (in the example illustrated in FIG. 12A, thebody object is an object image representing a diver suit) based on themodel data corresponding to the viewing user. In addition to the faceimage, the character object 833 a may include the parts, other than theface, of the character object showing a viewing user. Thus, thereproducer 275 can display the character objects indicating viewingusers who have given effect instructions in the order of input of theeffect instructions.

The transportation object 833 b is an object image which represents a“pail” and is displayed to float and move in a predetermined directionor along a predetermined movement route on the water surface in thefirst game stream screen 830. The transportation object 831 b may alsobe an object image representing a transportation other than “pail”, andmay not be displayed on the first game stream screen 830. In the exampleillustrated in FIG. 12A, the character object 833 a and thetransportation object 833 b are displayed in the vicinity of the rightside of the first game stream screen 830, then are moved in the leftdirection, and disappear in the vicinity of the left side of the firstgame stream screen 830.

When the character object 833 a is displayed, the reproducer 275 deletesfrom the effect instruction history table T3 the informationcorresponding to the effect instructions (the oldest effectinstructions) for the displayed character object 833 a among theinformation (viewing user ID, receive date/time, and points)corresponding to the effect instructions stored in the effectinstruction history table T3.

For display of the character object 833 a and the transportation object833 b, the executor 272 of the stream terminal 2 a produces the firstgame effect corresponding to the displayed character object 833 a and/ortransportation object 833 b.

The first game effect is, for instance, the effect of reducing the firstgame period (the execution time of the first game). For instance, whenthe first game period is 10 seconds, and the time by which the period isreduced is 0.2 seconds, with display of five character objects 833 a,the executor 272 reduces the first game period from 10 seconds to nineseconds. The first game effect may be an effect of extending the firstgame period (the execution time of the first game). Note that when thefirst game effect is an effect of reducing the first game period (theexecution time of the first game), the reproducer 275 may control thedisplay of the character object 833 a so that the character object 833 aautomatically performs a predetermined action (for instance, an actionof “scattering bait”) once.

The time of occurrence of the first game is when the character object833 a and/or the transportation object 833 b make appearance (aredisplayed for the first time), when display of the character object 833a and/or the transportation object 833 b ends, or a predetermined timepoint in the display period of the character object 833 a and/or thetransportation object 833 b.

FIG. 12B is a view illustrating another example of the first game streamscreen 840 displayed on the display unit 23 of the viewing terminal 2 b.In the same manner as the first game stream screen 840 illustrated inFIG. 11B, the first game stream screen 840 illustrated in FIG. 12Bincludes the character object 831 a, the transportation object 831 b,the fishing rod object 832 a, the fishing line object 832 b, the markobject 832 c, the evaluation button 811, the gift button 812, thecomment button 813, and the response information display area 814. Theevaluation button 811, the gift button 812, the comment button 813, andthe response information display area 814 illustrated in FIG. 12B havethe same functions as those of the evaluation button 811, the giftbutton 812, the comment button 813, and the response information displayarea 814 illustrated in FIG. 11B.

In the same manner as the reproducer 275 of the stream terminal 2 a, thereproducer 275 of the viewing terminal 2 b performs processing todisplay the character object 833 a and the transportation object 833 b,and performs processing to delete information in the effect instructionhistory table T3. In the same manner as the executor 272 of the streamterminal 2 a, for display of the character object 833 a and thetransportation object 833 b, the executor 272 of the viewing terminal 2b produces the first game effect corresponding to the displayedcharacter object 833 a and/or transportation object 833 b.

FIG. 13A is a view illustrating an example of the second game streamscreen 850 displayed on the display unit 23 of the stream terminal 2 a.The second game stream screen 850 includes a game object 851, a targetobject 852, a parameter cursor 853, a parameter gauge frame 854, and theresponse information display area 803. The response information displayarea 803 included in the second game stream screen 850 illustrated inFIG. 13A has the same function as that of the response informationdisplay area 803 included in the character stream screen 800.

The game object 851 is an object image representing fish, and iscontrolled and moved automatically along a predetermined path or arandomly determined path in the second game stream screen 850. Note thatan initial value is stored in the storage device 22 in association withthe game object 851, and the executor 272 sets an initial value inassociation with the game object 851 as the parameter value of the gameobject 851 at the start of the second game.

The target object 852 includes a first target object 852 a, a secondtarget object 852 b and a third target object 852 c. The first targetobject 852 a is an object image having a substantially circular shape,the second target object 852 b is an object image having a shape tosurround the circumference of the first target object 852 a, and thethird target object 852 c is an object image having a shape to surroundthe circumference of the second target object 852 b.

When the input device 24 is a touch panel, upon a tap operationperformed by a stream user on a predetermined display area in the secondgame stream screen 850, the input device 24 notifies the executor 272 ofgame input instructions. When the game input instructions are obtainedfrom the input device 24, the executor 272 of the stream terminal 2 adetermines in which one of the first target object 852 a, the secondtarget object 852 b and the third target object 852 c, a predeterminedposition (for instance, a position corresponding to the mouth of fish)of the game object 851 is located.

When determining in which one of the first target object 852 a, thesecond target object 852 b and the third target object 852 c, apredetermined position of the game object 851 is located, the executor272 changes (increases or decreases) the parameter value of the gameobject 851.

The executor 272 changes the amount of change in the parameter value ofthe game object 851 according to the location of the predeterminedposition of the game object 851 when the game input instructions areobtained from the input device 24.

When a predetermined position of the game object 851 is located at thefirst target object 852 a at the time of obtaining the game inputinstructions, the executor 272 decreases the parameter value of the gameobject 851 by a first decrement value. Note that in this case, theexecutor 272 may increase the parameter value of the game object 851 bya first increment value.

When a predetermined position of the game object 851 is located at thesecond target object 852 b at the time of obtaining the game inputinstructions, the executor 272 decreases the parameter value of the gameobject 851 by a second decrement value smaller than the first decrementvalue. Note that in this case, the executor 272 may increase theparameter value of the game object 851 by a second increment valuesmaller than the first increment value.

When a predetermined position of the game object 851 is located at thethird target object 852 c at the time of obtaining the game inputinstructions, the executor 272 decreases the parameter value of the gameobject 851 by a third decrement value smaller than the second decrementvalue. Note that in this case, the executor 272 may increase theparameter value of the game object 851 by a third increment valuesmaller than the second increment value.

When a predetermined position of the game object 851 is located outsidethe target object 852 at the time of obtaining the game inputinstructions, the executor 272 does not change the parameter value ofthe game object 851.

The parameter cursor 853 is a cursor object showing the parameter valueof the game object 851. The executor 272 places the parameter cursor 853at a position in the parameter gauge frame 854, the positioncorresponding to the parameter value of the game object 851. In theexample illustrated in FIG. 13A, the parameter cursor 853 is movable inthe parameter gauge frame 854 horizontally, and for a larger parametervalue of the game object 851, the parameter cursor 853 is placed at amore rightward position in the parameter gauge frame 854.

When the parameter value of the game object 851 reaches a predeterminedvalue (for instance, “0” (zero)) or less, the executor 272 determinesthat the viewing user has successfully played the second game, and endsthe second game. The executor 272 may determine that the viewing userhas successfully played the second game when the parameter value of thegame object 851 reaches a predetermined value (a value larger than theparameter value at the time of the start of the second game) or greater.The executor 272 may continue the second game until the second game issuccessfully played, or may terminate the second game when apredetermined second game period (for instance, 30 seconds) has elapsedsince the start of the second game regardless of whether or not thesecond game has been successfully played.

At the same time when the second game stream screen 850 is displayed bythe executor 272, the transmitter 273 of the stream terminal 2 atransmits game video data to the server apparatus 3 via thecommunication I/F 21, the game video data being for displaying a videoon the screen of the second game currently displayed. When the serverreceiver 331 of the server apparatus 3 receives the game video datatransmitted from the stream terminal 2 a via the communication I/F 31,the server streamer 332 of the server apparatus 3 transmits game videostream data to one or more viewing terminals 2 b via the communicationI/F 31, the game video stream data being contained in the game videodata and including a video on the game screen of the second game beingexecuted. When the receiver 274 of each viewing terminal 2 b receivesthe game video stream data from the server apparatus 3 via thecommunication I/F 21, the reproducer 275 of the viewing terminal 2 bdisplays the second game stream screen 860 (FIG. 13B) based on thereceived video stream data.

FIG. 13B is a view illustrating an example of the second game streamscreen 860 displayed on the display unit 23 of the viewing terminal 2 b.The second game stream screen 860 includes the game object 851, thetarget object 852, the parameter cursor 853, the parameter gauge frame854, the evaluation button 811, the gift button 812, the comment button813, and the response information display area 814. The evaluationbutton 811, the gift button 812, the comment button 813, and theresponse information display area 814 illustrated in FIG. 13B have thesame functions as those of the evaluation button 811, the gift button812, the comment button 813, and the response information display area814 illustrated in FIG. 10B.

The evaluation button 811 illustrated in FIG. 13B is an object image togive instructions for transmitting evaluation data on the gameplay of astream user in the second game stream screen 860. The gift button 812illustrated in FIG. 13B is an object image to give instructions fordisplaying the selection screen 820 to select a gift object. The commentbutton 813 illustrated in FIG. 13B is an object image to giveinstructions for displaying a comment input window to input a comment(character string) to be displayed on the second game stream screen 850and the second game stream screen 860.

FIG. 14A is a view illustrating another example of the second gamestream screen 850 displayed on the display unit 23 of the streamterminal 2 a. In the same manner as the second game stream screen 850illustrated in FIG. 13A, the second game stream screen 850 illustratedin FIG. 14A includes the game object 851, the target object 852, theparameter cursor 853, the parameter gauge frame 854, and the responseinformation display area 803. The response information display area 803illustrated in FIG. 14A has the function same as that of the responseinformation display area 803 illustrated in FIG. 13A.

During the progress of the second game, the reproducer 275 of the streamterminal 2 a retrieves information (viewing user ID, receive date/time,and points) on the oldest effect instructions stored in the effectinstruction history table T3 for every predetermined time interval (forinstance, for every one second). The reproducer 275 retrieves the modelID of a character object in association with the retrieved viewing userID, from the user table T1. The reproducer 275 reads model data inassociation with the retrieved model ID from the storage device 22. Thereproducer 275 then generates character object 855 based on the readmodel data, and displays the generated character object 855.

In the example illustrated in FIG. 14A, the character object 855 isformed by the face image of the character object showing the viewinguser, and the body object showing the body (in the example illustratedin FIG. 14A, the body object is an object image representing a diversuit) based on the model data corresponding to the viewing user. Inaddition to the face image, the character object 855 may include parts,other than the face, of the character object showing the viewing user.Thus, the reproducer 275 can display the character objects indicatingviewing users who have given effect instructions in the order of inputof the effect instructions. In the example illustrated in FIG. 14A, thecharacter object 855 is displayed in the vicinity of the left side ofthe second game stream screen 850, then is moved in the right direction,and disappears in the vicinity of the right side of the second gamestream screen 850.

When the character object 855 is displayed, the reproducer 275 deletesfrom the effect instruction history table T3 the informationcorresponding to the effect instructions (the oldest effectinstructions) for the displayed character object 833 a among theinformation (viewing user ID, receive date/time, and points)corresponding to the effect instructions stored in the effectinstruction history table T3.

For display of the character object 855, the executor 272 of the streamterminal 2 a produces the second game effect corresponding to thedisplayed character object 855.

The second game effect is, for instance, the effect of changing(increasing or decreasing) the parameter value of the game object 851.For instance, the game executor 272 changes the parameter value of thegame object 851 during display of the game object 851. The amount ofchange in the parameter value in the second game effect may be a randomvalue or a constant value. Alternatively, amount of change in theparameter value in the second game effect may be a value according to apredetermined parameter related to a stream user who has given effectinstructions for causing the game object 851 to appear. When the secondgame effect is an effect of changing the parameter value of the gameobject 851, the reproducer 275 may control the display of the characterobject 851 so that the character object 851 automatically performs apredetermined action (for instance, an action of moving in a directiontoward the target object 852 and returning to the original position)once.

The time of occurrence of the second game is when the character object855 makes appearance (is displayed for the first time), when display ofthe character object 855 ends, or a predetermined time point in thedisplay period of the character object 855.

FIG. 14B is a view illustrating another example of the second gamestream screen 860 displayed on the display unit 23 of the viewingterminal 2 b. In the same manner as the second game stream screen 860illustrated in FIG. 13B, the second game stream screen 860 illustratedin FIG. 14B includes the game object 851, the target object 852, theparameter cursor 853, the parameter gauge frame 854, the evaluationbutton 811, the gift button 812, the comment button 813, and theresponse information display area 814. The evaluation button 811, thegift button 812, the comment button 813, and the response informationdisplay area 814 illustrated in FIG. 14B have the same functions asthose of the evaluation button 811, the gift button 812, the commentbutton 813, and the response information display area 814 illustrated inFIG. 13B.

In the same manner as the reproducer 275 of the stream terminal 2 a, thereproducer 275 of the viewing terminal 2 b performs processing todisplay the character object 855, and performs processing to deleteinformation in the effect instruction history table T3. In the samemanner as the executor 272 of the stream terminal 2 a, for display ofthe character object 855, the executor 272 of the viewing terminal 2 bproduces the second game effect corresponding to the displayed characterobject 855.

FIG. 15A is a view illustrating another example of the second gamestream screen 850 displayed on the display unit 23 of the streamterminal 2 a. When it is determined that a viewing user has successfullyplayed the second game, the executor 272 displays on the display unit 23the second game stream screen 850 in which the parameter cursor 853 isplaced at the leftmost position in the parameter gauge frame 854 and agame success image 856 is included. After a predetermined time haselapsed since the display of the second game stream screen 850 includingthe game success image 856, the executor 272 of the stream terminal 2 a,ends the display of the second game stream screen 850, and displays agame result screen 870 on the display unit 23.

FIG. 15B is a view illustrating an example of the game result screen 870displayed on the display unit 23 of the stream terminal 2 a. The gameresult screen 870 includes an obtained game object 857 and the responseinformation display area 803.

The obtained game object 857 is an image showing a game object inassociation with the stream user depending on success of the secondgame. The obtained game object 857 includes information showing animage, a name, or predetermined points. The executor 272 stores anobject ID to identify the game object shown by the obtained game object857, in the storage device 22 in association with the user ID of astream user, thereby giving the game object shown by the obtained gameobject 857 to the stream user as a reward (benefit) for successfullyplayed second game.

Upon a tap operation performed by a stream user on a predetermineddisplay area in the game result screen 870, the input device 24 notifiesthe executor 272 of instructions for ending the game. The predetermineddisplay area may also be, for instance, the entire display area of thegame result screen 870, or may be a partial area of the game resultscreen 870 (for instance, a partial area of the entire display area ofthe game result screen 870 excluding the outer margin area).

When receiving instructions for ending the game from the input device24, the executor 272 ends the display of the game result screen 870, andinstructs the reproducer 275 to resume the display of the characterstream screen 800. Note that when the display of the second game streamscreen 850 ends, the executor 272 may instruct the reproducer 275 toresume the display of the character stream screen 800 without displayingthe game result screen 870. In this case, display of the game resultscreen 870 may be performed according to instructions for game resultdisplay.

FIG. 16A is a view illustrating an example of the character streamscreen 800 which has resumed its display on the display unit 23 of thestream terminal 2 a. In the same manner as the character stream screen800 illustrated in FIG. 7A, the character stream screen 800 illustratedin FIG. 16A includes the character object 801, the game start button802, and the response information display area 803. In addition, thecharacter stream screen 800 illustrated in FIG. 16A includes giftobjects 804 e to 804 i.

When receiving instructions for resuming display of the character streamscreen 800 from the executor 272, the reproducer 275 counts the numberof records of information on all or part of the effect instructionsstored in the effect instruction history table T3. The reproducer 275displays the counted number of specific gift objects in the characterstream screen 800 simultaneously or sequentially. When the number ofrecords of information on the effect instructions stored in the effectinstruction history table T3 is five as in the example illustrated inFIG. 16A, the reproducer 275 sequentially displays the specific giftobjects 804 e to 804 i corresponding to the five records of effectinstructions.

When the specific gift objects are displayed, the reproducer 275 deletesfrom the effect instruction history table T3 the informationcorresponding to the effect instructions for the displayed specific giftobjects among the information (viewing user ID, receive date/time, andpoints) corresponding to the effect instructions stored in the effectinstruction history table T3. After the display of the specific giftobjects corresponding to the information stored in the effectinstruction history table T3, or during the display of the specific giftobjects, the reproducer 275 performs display processing corresponding torequest stream data including a display request from the viewingterminal 2 b.

FIG. 16B is a view illustrating an example of a list screen 880displayed on the display unit 23 of the stream terminal 2 a. Thereproducer 275 displays the list screen 880 on the display unit 23 inresponse to selection by a stream user from predetermined list screenbuttons displayed on the display unit 23 of the stream terminal 2 a. Thelist screen 880 displays information showing the images, names orpredetermined points of the game objects given to the stream user eachas a reward (benefit) for successfully played second game in the past.

(Operation Sequence of Video Stream System 1)

FIG. 17 is a diagram illustrating an example of an operation sequence ofthe video stream system 1. The operation sequence is executed incooperation with the components of the terminal 2 and the serverapparatus 3 primarily by the processor 27 and the processor 33, based onthe program pre-stored in the storage device 22 and the storage device32. A description is given below under the assumption that a stream userUa operates a stream terminal 2 a, a viewing user Ub-1 operates aviewing terminal 2 b-1, and a viewing user Ub-2 operates a viewingterminal 2 b-2. Note that the video sequence illustrated in FIG. 17 isexecuted from the start to the end of a stream event, and is notexecuted from the start to the end of a game.

First, the transmitter 273 of the stream terminal 2 a transmitscharacter video data to the server apparatus 3 via the communication I/F21, the character video data including motion data generated by thegenerator 271 and the user ID of a stream user (step S101). Thetransmitter 273 may include the sound data of the stream user in thecharacter video data. The processing in step S101 is continuouslyexecuted for every predetermined time interval (for instance, for everytwo second interval) until the stream event ends, thus the processingaccording to step S101 to S106 is intermittently performed.

The reproducer 275 of the stream terminal 2 a generates drawing data todisplay a character stream screen based on the motion data (and sounddata) generated by the generator 271, and displays the character streamscreen on the display unit 23, based on the generated drawing data (stepS102).

Subsequently, the server streamer 332 of the server apparatus 3 streamscharacter video stream data including the character video data receivedfrom the stream terminal 2 a to the viewing terminal 2 b-1 and theviewing terminal 2 b-2 via the communication I/F 31 (step S103 andS104).

The reproducer 275 of the viewing terminal 2 b-1 generates drawing datato display a character stream screen based on the character video streamdata received by the receiver 274, and displays a character streamscreen on the display unit 23, based on the generated drawing data (stepS105). Similarly, the reproducer 275 of the viewing terminal 2 b-2generates drawing data to display a character stream screen based on thecharacter video stream data received by the receiver 274, and displays acharacter stream screen on the display unit 23, based on the generateddrawing data (step S106).

Subsequently, the transmitter 273 of the viewing terminal 2 b-1transmits to the server apparatus 3 via the communication I/F 21 adisplay request to display response information on the stream screen,input by the viewing user Ub operating the input device 24, and/or adisplay request to display a gift object corresponding to gift objectinformation on the stream screen (step S107).

In addition, the transmitter 273 of the stream terminal 2 a continuouslytransmits character video data to the server apparatus 3 via thecommunication I/F 21, the character video data including motion datagenerated by the generator 271 and the user ID of the stream user (stepS108). The transmitter 273 may include the sound data of the stream userin the character video data.

The server streamer 332 of the server apparatus 3 streams charactervideo stream data to the viewing terminal 2 b-1 via the communicationI/F 31, the character video stream data including motion data and sounddata (and a user ID) of the character video data received from thestream terminal 2 a (step S109), streams character video stream data andrequest stream data to the viewing terminal 2 b-2 via the communicationI/F 31, the character video stream data including motion data and sounddata (and a user ID) of the character video data received from thestream terminal 2 a, the request stream data including a display requesttransmitted from the viewing terminal 2 b-1 (step S110), and transmitsrequest stream data including the display request transmitted from theviewing terminal 2 b-1 to the stream terminal 2 a (step S111).

Subsequently, the reproducer 275 of the viewing terminal 2 b-1 generatesdrawing data to display a character stream screen, based on responseinformation input by the viewing user Ub operating the input device 24and the character video stream data received by the receiver 274, anddisplays a character stream screen on the display unit 23, based on thegenerated drawing data (step S112). The reproducer 275 of the viewingterminal 2 b-2 generates drawing data to display a character streamscreen based on the character video stream data and the request streamdata received by the receiver 274, and displays a character streamscreen on the display unit 23, based on the generated drawing data (stepS113). Furthermore, the reproducer 275 of the stream terminal 2 agenerates drawing data to display a character stream screen based on themotion data (and sound data) generated by the generator 271 and therequest stream data received by the receiver 274, and displays acharacter stream screen on the display unit 23, based on the generateddrawing data (step S114).

The transmitter 273 of the stream terminal 2 a transmits an end requestfor the stream event to the server apparatus 3 via the communication I/F21, the end request being in response to an end operation performed bythe stream user Ua on the input device 24 (step S115).

Subsequently, the server streamer 332 of the server apparatus 3 streamsend instructions for reproducing the stream event to the viewingterminal 2 b-1 and the viewing terminal 2 b-2 via the communication I/F31 (step S116 and S117).

Subsequently, the reproducer 275 of the viewing terminal 2 b-1 endsreproduction of the character stream screen according to the endinstructions received by the receiver 274 (step S118). The reproducer275 of the viewing terminal 2 b-2 ends the reproduction of the streamscreen according to character end instructions received by the receiver274 (step S119).

The reproducer 275 of the stream terminal 2 a which has transmitted theend instructions ends the reproduction of the character stream screen(step S120).

FIG. 18 is a diagram illustrating another example of an operationsequence of the video stream system 1. The operation sequence isexecuted in cooperation with the components of the terminal 2 (thestream terminal 2 a, the viewing terminal 2 b-1 and the viewing terminal2 b-2) and the server apparatus 3 primarily by the processor 27 and theprocessor 33, based on the program pre-stored in the storage device 22and the storage device 32. Note that the video sequence illustrated inFIG. 18 is executed from the start to the end of execution of a game.

First, the executor 272 of the stream terminal 2 a performs game streamscreen display processing (step S201). The game stream screen displayprocessing will be described below. The processing in step S201 iscontinuously executed for every predetermined time interval (forinstance, for every two second interval) until the stream event ends,thus the processing according to step S201 to S206 is intermittentlyperformed.

Subsequently, the transmitter 273 of the stream terminal 2 a transmitsgame video data to the server apparatus 3 via the communication I/F 21,the game video data including display data to display a video on thegame screen of the game being executed, and the stream user ID stored inthe storage device 22 (step S202). The transmitter 273 may include thesound data of the stream user in the game video data.

Subsequently, the server streamer 332 of the server apparatus 3 streamsgame video stream data to the viewing terminal 2 b-1 and the viewingterminal 2 b-2 via the communication I/F 31, the game video stream databeing contained in the game video data received by the server receiver331 and including a video on the game screen of the game being executed(step S203 and S204).

The reproducer 275 of the viewing terminal 2 b-1 performs the gamestream screen display processing based on the game video stream datareceived by the receiver 274 (step S205). Similarly, the reproducer 275of the viewing terminal 2 b-2 performs the game stream screen displayprocessing based on the character video stream data received by thereceiver 274 (step S206). The game stream screen display processing willbe described below.

Subsequently, the transmitter 273 of the viewing terminal 2 b-1transmits to the server apparatus 3 via the communication I/F 21 adisplay request to display response information on the stream screen,input by the viewing user Ub operating the input device 24, and/or adisplay request to display a gift object corresponding to gift objectinformation on the stream screen (step S207).

In addition, the transmitter 273 of the stream terminal 2 a continuouslytransmits game video data to the server apparatus 3 via thecommunication I/F 21, the game video data including display data todisplay a video on the game screen of the game being executed, and thestream user ID stored in the storage device 22 (step S208). Thetransmitter 273 may include the sound data of the stream user in thecharacter video data.

The server streamer 332 of the server apparatus 3 streams game videostream to the viewing terminal 2 b-1 via the communication I/F 31, thegame video stream data being contained in the game video data receivedfrom the stream terminal 2 a and including a video on the game screen ofthe first game being executed, (step S209), streams request stream datato the viewing terminal 2 b-2 via the communication I/F 31, the requeststream data including the game video stream data being contained in thegame video data received from the stream terminal 2 a and including avideo on the game screen of the first game being executed, and a displayrequest transmitted from the viewing terminal 2 b-1 (step S210), andtransmits request stream data including the display request transmittedfrom the viewing terminal 2 b-1 to the stream terminal 2 a (step S211).

The executor 272 and the reproducer 275 of the stream terminal 2 aperform the game stream screen display processing based on the requeststream data received by the receiver 274 (step S212). In addition, thereproducer 275 of the viewing terminal 2 b-1 performs the game streamscreen display processing based on the response information input by theviewing user Ub operating the input device 24 and the game video streamdata received by the receiver 274 (step S213). Furthermore, thereproducer 275 of the viewing terminal 2 b-2 performs the game streamscreen display processing based on the game video stream data and therequest stream data received by the receiver 274 (step S214).

FIG. 19 is a chart illustrating an example of an operation flow of thegame stream screen display processing performed by the executor 272 andthe reproducer 275 of the terminal 2 (the stream terminal 2 a and theviewing terminal 2 b). The game stream screen display processingillustrated in FIG. 19 is performed in step S201, S205, S206, S212, S213and S214 of FIG. 18 .

At first, the executor 272 determines whether the first progresscondition is met (step S301). The first progress condition is forprogressing the first game, and is, for instance, that the input device24 has received instructions for executing a game and the present timeis within the first game period since the reception of the instructionsfor executing a game. The first game period in the first progresscondition may start in each of the following situations: when apredetermined first game start time is reached, when the virtualmonetary value possessed by a stream user is greater than or equal to apredetermined value, less than a predetermined value, or greater than orequal to a first predetermined value and less than a secondpredetermined value, and when the number of viewing terminals 2 b whichdisplay a stream event is greater than or equal to a predeterminednumber, less than a predetermined number, or greater than or equal to afirst predetermined number and less than a second predetermined number.The first game period may end when the stream user successfully playsthe first game.

When determining that the first progress condition is not met (No instep S301), the executor 272 determines whether the second progresscondition is met (step S302). The second progress condition is that atthe present time, the first game period has elapsed since the receptionof the instructions for executing a game from the input device 24 (afterthe first game has ended and the second game has started), and an endcondition for the second game is not met. For instance, the endcondition for the second game is that a viewing user has successfullyplayed the second game. The end condition for the second game may bethat the second game period has elapsed since the start of the secondgame.

When determining that the second progress condition is met (Yes in stepS302), the executor 272 proceeds to step S307. The processing in stepS307 will be described below.

When determining that the second progress condition is not met (No instep S302), the executor 272 proceeds to step S311. The processing instep S311 will be described below.

When determining that the first progress condition is met (Yes in stepS301), the executor 272, or the executor 272 and the reproducer 275display the first game (step S303). The executor 272 of the streamterminal 2 a progresses the first game based on the various commandscontained in the control program (game program) stored in the storagedevice 22 and a game operation input by the stream user, and displays agame stream screen including the screen of the first game in progress onthe display unit 23. The reproducers 275 of the viewing terminal 2 b-1and the viewing terminal 2 b-2 generate drawing data to display a gamestream screen including a video on the screen of the first game based onthe game video stream data received by the receiver 274, and displays agame stream screen on the display unit 23, based on the generateddrawing data.

During the progress of the first game, the executor 272 determineswhether information (viewing user ID, receive date/time, and points) oneffect instructions is stored in the effect instruction history table T3(step S304).

When determining that information on effect instructions is not storedin the effect instruction history table T3 (No in step S304), theexecutor 272 proceeds to step S306.

When determining that information on effect instructions is stored inthe effect instruction history table T3 (Yes in step S304), the executor272 retrieves information (viewing user ID, receive date/time, andpoints) on the oldest effect instructions stored in the effectinstruction history table T3 for every predetermined time interval (forinstance, for every one second), and produces the first game effectcorresponding to the retrieved effect instructions (step S305).

Subsequently, the executor 272 determines whether the second progresscondition is met (step S306).

When determining that the second progress condition is not met (No instep S306), the executor 272 returns the processing to step S304.

When determining that the second progress condition is met (Yes in stepS306), the executor 272, or the executor 272 and the reproducer 275display the second game (step S307). The executor 272 of the streamterminal 2 a progresses the second game based on the various commandscontained in the control program (game program) stored in the storagedevice 22 and a game operation input by the stream user and displays agame stream screen including the screen of the second game in progresson the display unit 23. The reproducers 275 of the viewing terminal 2b-1 and the viewing terminal 2 b-2 generate drawing data to display agame stream screen including a video on the screen of the second gamebased on the game video stream data received by the receiver 274, anddisplays a game stream screen on the display unit 23, based on thegenerated drawing data.

During the progress of the second game, the executor 272 determineswhether information (viewing user ID, receive date/time, and points) oneffect instructions is stored in the effect instruction history table T3(step S308).

When determining that information on effect instructions is not storedin the effect instruction history table T3 (No in step S308), theexecutor 272 proceeds to step S310.

When determining that information on effect instructions is stored inthe effect instruction history table T3 (Yes in step S308), the executor272 retrieves information (viewing user ID, receive date/time, andpoints) on the oldest effect instructions stored in the effectinstruction history table T3 for every predetermined time interval (forinstance, for every one second), and produces the second game effectcorresponding to the retrieved effect instructions (step S309).

Subsequently, the executor 272 determines whether the end condition forthe second game is met (step S310).

When determining that the end condition for the second game is not met(No in step S310), the executor 272 returns the processing to step S308.

When determining that the end condition for the second game is met (Yesin step S310), the executor 272, or the executor 272 and the reproducer275 display a game result screen on the display unit 23 (step S311). Theexecutor 272 of the stream terminal 2 a ends the second game based onvarious commands contained in the control program (game program) storedin the storage device 22, and displays a game result screen on thedisplay unit 23, the game result screen including obtained game objectsgiven to the stream user. The reproducers 275 of the viewing terminal 2b-1 and the viewing terminal 2 b-2 generate drawing data to display agame result screen including obtained game objects given to the streamuser, based on the game video stream data received by the receiver 274,and displays a game result screen on the display unit 23, based on thegenerated drawing data.

Subsequently, each reproducer 275 determines whether information(viewing user ID, receive date/time, and points) on effect instructionsis stored in the effect instruction history table T3 (step S312).

When determining that information on effect instructions is not storedin the effect instruction history table T3 (No in step S312), thereproducer 275 ends the game stream screen display processing.

When determining that information on effect instructions is stored inthe effect instruction history table T3 (Yes in step S312), thereproducer 275 counts the number of records of information on all storedeffect instructions, notifies the reproducer 275 of instructions fordisplaying the counted number of specific gift objects in the characterstream screen 800 (step S313), and ends the game stream screen displayprocessing.

Note that in the processing procedure illustrated in FIGS. 17 to 19 , itis possible to omit part of the processes (steps) included in theprocessing procedure, add a process to the processes included in theprocessing procedure and/or change the order of the processes. As longas not departing from the spirit of the present disclosure, theprocessing procedure which has undergone such omission, addition, orchange is also included in the scope of the present disclosure.

As described in detail above, in the video stream system 1 of theembodiment, even when the same effect instructions are input by aviewing user, an event effect according to a stream screen beingdisplayed and/or video stream data being transmitted is produced.Specifically, the selection screen 820 can be displayed by selecting anyof the gift button 812 included in the character stream screen 810 (FIG.7B, FIG. 9A), the gift button 812 included in the first game streamscreen 840 (FIG. 10B, FIG. 11B, FIG. 12B), and the gift button 812included in the second game stream screen 860 (FIG. 13B, FIG. 14B) by aviewing user. When a gift object corresponding to a candidate object inthe displayed selection screen 820 is a specific gift object, in each ofthe character stream screen 810 being displayed, the first game streamscreen 840 being displayed, and the second game stream screen 860 beingdisplayed, the video stream system 1 can produce event effects differentfrom each other. In this manner, the video stream system 1 of theembodiment makes it possible to improve the game performance of eachgame stream screen, and enhance the sense of togetherness between thestream user and the viewing users for each stream event without usingrespective user interfaces for the stream screen being displayed and/orthe video stream data being transmitted (without making the userinterface complicated). In addition, in the video stream system 1, it isnot necessary to install user interfaces to produce different eventeffects for each type of the stream screen being displayed, and toperform screen display processing to implement each of the userinterfaces, thus delay of information processing due to a processingload of the terminal 2 can be prevented in advance. In addition, in thevideo stream system 1, each viewing user has only to input the sameeffect instructions to produce different event effects for each type ofthe stream screen being displayed. Thus, in the communication method ofvideo stream system 1, as compared with when different instructionrequests are transmitted for each type of the stream screen duringdisplay, the load of communication network can be further reduced.

(Modification 1)

Note that the present disclosure is not limited to the embodiment. Forinstance, the game provided by the video stream system 1 of theembodiment is not limited to a fishing game, and sports games other thanthe fishing game may be provided.

When the game provided by the video stream system 1 is a golf game, forinstance, the first game provides a game during a period in which theball is hit from the teeing ground and lands on the green, and thesecond game provides a game on the green. In this case, upon a tapoperation performed by a stream user on a predetermined display area inthe first game stream screen 840 and the second game stream screen 850,the input device 24 notifies the executor 272 of game inputinstructions. When receiving the game input instructions from the inputdevice 24, the executor 272 displays a ball object to be moved by a shotor a putt. The second game starts when the ball object lands on thegreen, and ends when the ball enters the cup with the second gamesuccessfully played.

In this case, the first game effect is at least of the following typesof effects: the effect of extending the flying distance of the ballobject, the effect of changing the flying direction of the ball to adirection toward the green, and the effect of changing (decreasing orincreasing) the number of shots of the ball object. The second gameeffect is at least one of the following types of effects: the effect ofincreasing the flying distance of the ball object when the flyingdistance is shorter than the distance to the cup, the effect ofdecreasing the flying distance of the ball object when the flyingdistance is longer than the distance to the cup, the effect of changethe flying direction of the ball to a direction toward the cup, and theeffect of changing (decreasing or increasing) the number of shots of theball object.

A game provided by the video stream system 1 may have multiple gamestages. In this case, the first game is the one on a specific game stagebetween the multiple game stages, and the second game is the one on thegame stage immediately after the game stage of the first game.

In this case, the first game effect is at least one of the followingtypes of effects: the effect of changing (extending or reducing) thefirst game period, the effect of changing (decreasing or increasing) thepoints earned by the stream user in the first game, and the effect ofchanging (for instance, changing (decreasing or increasing) theparameter value of a game medium and/or replacing an earned game mediumwith another game medium) a game medium earned by the stream user in thefirst game. The second game effect is at least one of the followingtypes of effects: the effect of changing (extending or reducing) thesecond game period, the effect of changing (decreasing or increasing)the points earned by the stream user in the second game, and the effectof changing (for instance, changing (decreasing or increasing) theparameter value of a game medium and/or replacing an earned game mediumwith another game medium) a game medium earned by the stream user in thesecond game.

(Modification 2)

The effect instructions according to the information to be stored as anew record in the effect instruction history table T3 are not limited todisplay request for one type of a specific gift object, and may bedisplay request for multiple types of specific gift objects. In thiscase, during the progress of the first game, the reproducer 275retrieves information (viewing user ID, receive date/time, and points)on the oldest effect instructions stored in the effect instructionhistory table T3 for every predetermined time interval (for instance,for every one second), retrieves the model ID of a character object inassociation with the retrieved viewing user ID from the user table T1,and generates the character object 833 a based on model data inassociation with the retrieved model ID. The reproducer 275 retrievesthe transportation object 833 b corresponding to the retrieved pointfrom the storage device 22. The reproducer 275 then displays thegenerated character object 833 a and the retrieved transportation object833 b on the first game stream screens 830 and 840. In this case, eachof multiple types of transportation objects 833 b has a display colorwhich is different from those of other transportation objects 833. Inthis manner, the display color of the displayed transportation object833 is changed in response to the points of a specific gift object givento the stream user by a viewing user.

Similarly, the body object of the character object 855 displayed by thereproducer 275 during the progress of the second game may have a displaycolor corresponding to the points of information on the effectinstructions according to the character object 855.

(Modification 3)

The total value of points in association with all types of specific giftobjects given to the stream user by viewing users may be stored in thestorage device 22 of the terminal 2 and/or the storage device 32 of theserver apparatus 3. The reproducer 275 of each terminal 2 may displaythe ranking of the stream users, based on the total value of the storedpoints.

(Modification 4)

In the list screen 880 illustrated in FIG. 16B, the image of each gameobject given to the stream user may include the character object of aviewing user who has made a display request (in other words, “effectinstructions”) for a specific gift object in the game period of the game(the first game and the second game) played when the game object isgiven. Thus, the game object given as an earned object as well as thecharacter object of a viewing user in cooperation with the game can beplaced in one image, thus commitment of each viewing user to participatein a stream event can be improved.

When a display request transmitted from the viewing terminal 2 b duringthe display of the game stream screen is for a gift object other thanthe specific gift objects, the receiver 274 may store information on thegift object according to the display request in the storage device 22 asa non-display gift object. When the game ends, and the display of thecharacter stream screen resumes, the non-display gift objects stored inthe storage device 22 may be displayed in the character stream screensimultaneously or sequentially.

(Modification 5)

At least part of the function implemented by the processor 27 of theterminal 2 may be implemented by a processor other than the processor 27of the terminal 2. At least part of the function implemented by theprocessor 27 may be implemented, for instance, by the processor 33 ofthe server apparatus 3. Specifically, part of the function (function ofgenerating a character object animation and/or function of generating astream screen) of the reproducer 274 may be performed in the serverapparatus 3. For instance, character video stream data to display acharacter stream screen generated in the stream terminal 2 a istransmitted to each viewing terminal 2 b, and each viewing terminal 2 bmay display the character stream screen based on the received charactervideo stream data. The transmitter 272 of the stream terminal 2 a maytransmit the video data of a character stream screen to the viewingterminal 2 b via the server apparatus 3, the character stream screenbeing displayed based on the drawing data generated by the reproducer274 of the stream terminal 2 a. Consequently, the viewing terminal 2 bof a viewing user can display the same stream screen as that displayedon the stream terminal 2 a only by obtaining the video data. Forinstance, in the operation sequence illustrated in FIG. 17 , thereproducer 274 of the stream terminal 2 a performs step S102 withoutperforming step S101, S103 and S104. Next, the transmitter 272 of thestream terminal 2 a transmits the video data of the character streamscreen displayed in step S102, and the server streamer 332 of the serverapparatus 3 streams the video data received from the stream terminal 2 ato the viewing terminals 2 b-1 and 2 b-2 via the communication I/F 31.In addition, step S108 to S110 are not performed, and the transmitter272 of the stream terminal 2 a transmits the character video data of thestream screen displayed in step S114, and the server streamer 332 of theserver apparatus 3 streams character video stream data including thecharacter video data received from the stream terminal 2 a to theviewing terminals 2 b-1 and 2 b-2 via the communication I/F 31.

(Modification 6)

The stream screen displayed on the stream terminal 2 a and the streamscreen displayed on the viewing terminal 2 b may be the same screen.

What is claimed is:
 1. A terminal, comprising: a memory; a touch paneldisplay; and processing circuitry configured to execute instructionsstored in the memory to: control the touch panel display to display acharacter video including a first character object representing a streamuser; transmit character information to a plurality of viewing userterminals to display the character video to a plurality of viewing usersdifferent from the stream user; control the touch panel display todisplay a screen for a game played by the stream user; transmit gameinformation to the plurality of viewing user terminals to display thegame video to the plurality of viewing users; and produce a game effectaccording to instructions for the stream user from a viewing userterminal of one viewing user of the plurality of viewing users, whereindisplay of the screen includes displaying at least one of a screen for afirst game and a screen for a second game as the screen for the gameaccording to a progress of the game, the screen for the second gameincludes an image showing a predetermined game medium that is associatedwith points, a game effect on the second game is an effect of changingthe points, and to produce the game effect, the processing circuitry:determines whether the game effect to be produced is a game effect onthe first game, and in a case that the determining indicates that thegame effect to be produced is not a game effect on the first game,produces a game effect on the second game which is an effect of changingthe points.
 2. The terminal according to claim 1, wherein during displayof the character video, a gift object according to instructions for thestream user from the viewing user terminal of the one viewing user isdisplayed.
 3. The terminal according to claim 2, wherein the processingcircuitry is further configured to, upon an end of the game: control thetouch panel display to end display of the screen for the game and tostart display of the character video; and control the touch paneldisplay to display, upon the start of the display of the charactervideo, a gift object according to each of the instructions given duringexecution of the game.
 4. The terminal according to claim 2, wherein afirst character image showing the first character object is included inthe screen for the first game and is not included in the screen for thesecond game.
 5. The terminal according to claim 2, wherein a secondcharacter image showing a second character object is included in thescreen for the first game and in the screen for the second game, thesecond character object representing a viewing user that has providedinstructions for the stream user.
 6. The terminal according to claim 1,wherein the second game starts in response to an end of execution of thefirst game, and the game effect on the first game is an effect ofreducing an execution time of the first game.
 7. The terminal accordingto claim 1, wherein the predetermined game medium is automaticallyselected from a plurality of game media according to a progress of thefirst game, and the game effect on the first game is an effect ofincreasing a selection probability of a specific type of a game medium.8. The terminal according to claim 1, wherein the processing circuitryis further configured to: change the points in response to a gameoperation of the stream user in the second game; and upon the pointsreaching a predetermined number of points, end execution of the secondgame and associating a game medium image with the stream user, the gamemedium image showing the predetermined game medium.
 9. The terminalaccording to claim 8, wherein the processing circuitry is furtherconfigured to associate, upon the points reaching the predeterminednumber of points in the second game, an image with each of the streamuser and the viewing user that provided the instructions duringexecution of the second game, and the image includes: the game mediumimage showing the predetermined game medium, an image showing the firstcharacter object representing the stream user, and an image showing asecond character object representing the viewing user that provided theinstructions.
 10. A terminal, comprising: a memory; and processingcircuitry configured to execute instructions stored in the memory to:receive character information to display a character video including afirst character object representing a stream user from a streaming userterminal of the stream user; receive game information to display a gamevideo including a screen for a game played by the stream user from thestreaming user terminal; and transmitting instructions for the streamuser to produce a game effect, wherein display of the game videoincluding the screen includes displaying at least one of a screen for afirst game and a screen for a second game as the screen for the gameaccording to a progress of the game, the screen for the second gameincludes an image showing a predetermined game medium that is associatedwith points, a game effect on the second game is an effect of changingthe points, and producing of the game effect includes: determiningwhether the game effect to be produced is a game effect on the firstgame, and in a case that the determining indicates that the game effectto be produced is not a game effect on the first game, a game effect onthe second game, which is an effect of changing the points, is produced.11. The terminal according to claim 10, wherein during display of thecharacter video, a gift object according to the instructions for thestream user is displayed.
 12. The terminal according to claim 11,wherein a first character image showing the first character object isincluded in the screen for the first game and is not included in thescreen for the second game.
 13. The terminal according to claim 11,wherein a second character image showing a second character object isincluded in the screen for the first game and in the screen for thesecond game, the second character object representing a viewing userthat has provided instructions for the stream user.
 14. The terminalaccording to claim 10, wherein the second game starts in response to anend of execution of the first game, and the game effect on the firstgame is an effect of reducing an execution time of the first game. 15.The terminal according to claim 10, wherein the predetermined gamemedium is automatically selected from a plurality of game mediaaccording to a progress of the first game, and the game effect on thefirst game is an effect of increasing a selection probability of aspecific type of a game medium.
 16. A server communicable with a streamterminal of a stream terminal and a viewing terminal of a viewing userdifferent from the stream user, the server comprising: a memory; andprocessing circuitry configured to execute instructions stored in thememory to: receive character information from the stream terminal, thecharacter information to display a character video including a firstcharacter object representing the stream user; transmit the characterinformation and the game information to the viewing terminal; receivegame information from the stream terminal, the game information todisplay a game video including a screen for a game played by the streamuser; receive instructions, from the viewing terminal, for the streamuser to produce a game effect; and transmit the instructions to thestream terminal to produce the game effect, wherein display of thescreen includes displaying at least one of a screen for a first game anda screen for a second game as the screen for the game according to aprogress of the game, the screen for the second game includes an imageshowing a predetermined game medium that is associated with points, agame effect on the second game is an effect of changing the points, andthe instructions instruct the stream terminal to: determine whether thegame effect to be produced is a game effect on the first game, and in acase that the determining indicates that the game effect to be producedis not a game effect on the first game, produce a game effect on thesecond game which is an effect of changing the points.
 17. The serveraccording to claim 16, wherein to produce the game effect the streamterminal determines whether the game effect to be produced is a gameeffect on the first game, and upon determination that the game effect tobe produced is not a game effect on the first game, produces a gameeffect different from the game effect on the first game.
 18. The serveraccording to claim 16, wherein a gift object according to theinstructions for the stream user is displayed during display of thecharacter video.